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Abstract 

In this paper, we have estabhshed a general framework of niuhistage hypothesis tests which 
apphes to arbitrarily many mutually exclusive and exhaustive composite hypotheses. Within 
the new framework, we have constructed specific multistage tests which rigorously control 
the risk of committing decision errors and are more efficient than previous tests in terms of 
average sample number and the number of sampling operations. Without truncation, the 
sample numbers of our testing plans are absolutely bounded. 
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1 Introduction 

Let X be a random variable defined in a probability space (r2,^,Pr). Suppose the distribution 
of X is determined by an unknown parameter in a parameter space 0. In many applications, 
it is desirable to infer the true value of 9 from random samples Xi,X2, ■ ■ ■ oi X. This topic can 
be formulated as a general problem of testing m mutually exclusive and exhaustive composite 
hypotheses: 

J^O-OG&o, J^i:e€@i, J^m-i ■■ e (1) 

where = {9 e @ : 9 < 9i}, &rn-i = {9 e & : 9 > 9,m-i} and @i = {9 e S : 9i < 9 < 
9i^i}, i = 1, - ■ ■ ,m — 2 with 9i < 92 < ■ ■ ■ < ^m-i- To control the probabilities of making wrong 
decisions, it is typically required that, for pre-specified numbers 5i G (0, 1), 

Pr{ Accept J^i \ 9} > 1 - 5i, y9 £ 0i, i = 0, 1, • • • , m - 1 (2) 
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with Oo = {9 e&o: 9 < 9[}, Om-i = {9 e 0„_i : 9 > C-il and Oi = {9 e &^ : 9'/ < 9 < 
9i^i}, i = I, - • • ,m — 2, where 9'-, 9'! are parametric values in such that 9'^ < 9i, 9'^_i > 9m.^i 
and 9i^i < 9'1_^ < 9'- < 9i < 9'/ < 9'^^^ < 9i+i for i = 2, • • • , m - 2. For i = 0, 1, • • • , m - 1, 
Pr{ Accept ^ | 9} is referred to as an Operating Characteristic (OC) function. Since there is no 
requirement imposed for controlling the risk of making wrong decisions for ^ in \ U^^I^^Oj = 
^^l^^{9i,9'/), such a remainder set, U^^^(^-, 6*^'), is referred to as an indifference zone. The 
concept of indifference zone was introduced by Wald [8] for two main reasons. First, when the 
parameter 9 is close to 9i, the margin between adjacent parameter subsets 0i_i and 0j, it is 
immaterial to decide whether or J^i should be accepted. Second, the sample size required 

to make a reliable decision between consecutive hypotheses J^i-i and J^i becomes increasingly 
intolerable as 9 tends to 9i. Undoubtedly, the indifference zone should be sufficiently "narrow" so 
that the consequence of making erroneous decision is practically unimportant when 9 lies in it. 

The general problem of hypothesis testing described above has been a fundamental issue of 
research for many decades. The well-known sequential probability ratio test (SPRT) has been 
developed by Wald [8] to address such testing problem in the special case of two hypotheses. 
In addition to the limitation associated with the number of hypotheses, the SPRT suffers from 
other drawbacks. First, the sample number of SPRT is a random number which is not bounded. 
However, to be useful, the sample number of any testing plan should be bounded by a deterministic 
number. Although this can be fixed by forced termination (see, e.g., [6] and the references therein), 
the prescribed level of power may not be ensured as a result of truncation. Second, the number of 
sampling operations of SPRT is as large as the number of samples. In practice, it is usually much 
more economical to take a batch of samples at a time instead of one by one. Third, the efficiency 
of SPRT is optimal only for the endpoints of the indifference zone. For other parametric values, 
the SPRT can be extremely inefficient. Needless to say, a truncated version of SPRT may suffer 
from the same problem due to the partial use of the boundary of SPRT. 

In this paper, to overcome the limitations of SPRT and its variations, we have established a new 
framework of hypothesis testing which applies to arbitrary number of composite hypotheses. Our 
testing plans have the following features: i) The testing process has a finite number of stages and 
thus the cost of sampling operations is reduced as compared to SPRT; ii) The sample number is 
absolutely bounded without truncation; iii) The prescribed level of power is rigorously guaranteed; 
iv) The testing is not only efficient for the endpoints of indifference zone, but also efficient for other 
parametric values. The remainder of the paper is organized as follows. In Section 2, we present our 
general theory and computational mechanisms for the design and analysis of multistage testing 
plans. In Section 3, we first present more specific construction of testing procedures and then 
apply the general method to common important problems. Specially, we demonstrate that the 
principle can be used for testing a binomial proportion, the proportion of a finite population, a 
Poisson parameter, the mean of a normal distribution with known variance, the variance of a 
normal distribution, the parameter of an exponential distribution and life testing. Section 4 is 
dedicated to tests of the mean of a normal distribution with unknown variance. Section 5 is the 
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conclusion. All proofs of theorems are given in Appendices. 

Throughout this paper, we shall use the following notations. The set of real numbers is 
denoted by M. The set of integers is denoted by Z. The set of positive integers is denoted by 
N. The notation denotes an empty set. The ceiling function and floor function are denoted 
respectively by [.] and [.J (i.e., [x] represents the smallest integer no less than x; [x\ represents 
the largest integer no greater than x). The gamma function is denoted by r(.). For any integer 
i, the combinatoric function (*) with respect to integer j takes value Y{j+i)rli~j+i) ^'^^ J ^ ^ 
and value otherwise. The expectation of a random variable is denoted by E[.]. We use the 
notation Pr{. | 9} to denote the probability of an event which is defined in terms of random 
variables parameterized by 9. The parameter 9 in Pr{. | 9} may be dropped whenever this can 
be done without introducing confusion. If Z is parameterized by 6, we denote Pr{Z < z \ 9} 
by Fz{z,9) and Pr{Z > z \ 6} hy Gz{z,9) respectively. The cumulative distribution function 
of a Gaussian random variable is denoted by $(.). For a S (0,1), Za denotes the critical value 
satisfying ^{Za) = 1 — a. For a G (0,1), let Xna denote the 100a% percentile of a chi-square 
distribution of n degrees of freedom. For a G (0, 1), let tn,a denote the 100(1 — a)% percentile of 
a Student t-distribution of n degrees of freedom. The support of a random variable Z is denoted 
by Iz, i.e., Iz = : uj € 0}. We write 6 = 0(C) if ^ is a function of ^ > such that there 

exist constants A and B such that A < ^ < B provided that ^ > is sufficiently small. The other 
notations will be made clear as we proceed. 

2 General Theory and Computational Machinery 

In this section, we shall discuss a general theory of multistage hypothesis tests. A central theme 
of our theory is on the reduction of the computational complexity associated with the design and 
analysis of multistage testing plans. 

2.1 Basic Structure 

In general, a testing plan in our proposed framework consists of s stages. For £ = 1, • • • , s, the 
number of available samples (i.e., sample size) of the £-th stage is denoted by ni. For the £-th 
stage, a decision variable = ^^(Xi, • • • , X^) is defined in terms of samples Xi, • • • , X^^ such 
that Di assumes m + 1 possible values 0, 1, • • • , m with the following notion: 

(i) Sampling is continued until ^ for some £ G {1, • • • , s}. 

(ii) The hypothesis is accepted at the £-th stage if Di = j + 1 and Di = for 1 < i < i. 
For practical considerations, we shall only focus on sampling schemes which are closed in the 

sense that Pr{Ds = 0} = 0. For efficiency, a sampling scheme should satisfy the condition that 
both Pt{Di 7^ 0} and Pr{Z)s_i = 0} are greater than zero. 

Let I denote the index of stage when the sampling is terminated. Then, the sample number 
when the sampling is terminated, denoted by n, is equal to n^. For the i-th stage, an estimator 
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6^ for 6 can be defined based on samples Xi, • • • Consequently, the overall estimator for 

6, denoted by 0, is equal to 6i. In many cases, decision variables Di can be defined in terms of 
6(^. Specially, if 0^ is a Unimodal-Likelihood Estimator (ULE) of for I = 1, • • • ,s, the design 
and analysis of multistage sampling schemes can be significantly simplified. For a random tuple 
Xi, ■ ■ ■ ,X,. (of deterministic or random length r) parameterized by 9, we say that the estima- 
tor (p{Xi, ■ ■ ■ ,Xr) is a ULE of if 99 is a multivariate function such that, for any observation 
(xi, • • • , Xr) of {Xi, • • • , Xr), the likelihood function is non-decreasing with respect to 6 no greater 
than (p{xi, ■ ■ ■ ,Xr) and is non-increasing with respect to 9 no less than <p{xi, ■ ■ ■ ,Xr). For dis- 
crete random variables Xi, ■ ■ ■ , Xr, the associated likelihood function is the joint probability mass 
function Pr{Xj = Xi, i = 1, ■ ■ ■ ,r \ 6}. For continuous random variables Xi, ■ ■ ■ ,Xr, the corre- 
sponding likelihood function is, fxi,-,Xrixi, • • • ,Xr,9), the joint probability density function of 
random variable Xi, ■ ■ ■ ,Xr- It should be noted that a ULE may not be a maximum-likelihood 
estimator (MLE). On the other side, a MLE may not be a ULE. 

In the sequel, we shall focus on multistage sampling schemes which can be defined in terms 
of estimator = (p{Xi, • • • , Xn) such that is a ULE of 9 for every n and that converges 
in probability to 9 in the sense that, for any e > and 5 G (0, 1), Pr{|(^,„ — 9\ > e} < 5 provided 
that n is sufficiently large. Such estimator (p^i is referred to as a Unimodal-likelihood Consistent 
Estimator (ULCE) of 9. For the ^-th stage, the estimator 9i is defined as yj^^ = (p{Xi, ■ ■ ■ 
Accordingly, the decision variables Di can be defined in terms of estimator 9i = (Png- 

2.2 Bisection Risk Tuning 

To avoid prohibitive burden of computational complexity in the design process, our global strategy 
is to construct multistage sampling schemes of certain structure such that the risks of erroneously 
accepting or rejecting a hypothesis can be adjusted by some parameter ( > 0. Such a parameter 
C is referred to as a risk tuning parameter in this paper to convey the idea that ( is used to 
"tune" the risk of making a wrong decision to be acceptable. As will be seen in the sequel, by 
virtue of the concept of ULE, we are able to construct a class of multistage testing plans such 
that the risks can be "tuned" to be no greater than prescribed levels by making the risk tuning 
parameter sufficiently small. Moreover, the risk tuning can be accomplished by a bisection 
search method. Furthermore, the OC functions of these multistage testing plans possess some 
monotonicity which makes it possible to control the probabilities of committing decision errors 
by checking the endpoints of indifference zone. 

For the ease of presentation of our sampling schemes, we need to introduce some multivariate 
functions regarding estimator = v'(^i) " " " ! ^n) of 9. For n £ N,9 £ &,6 £ {0, 1), define 




: F^Jz,9) <5, z<e} if {F^J<p„,0) < 5, <p„ < ^ ^ 0, 



(z, e)<s,z>e} if {G^„ 9) <s,<f^>e}^ 0, 



otherwise 



otherwise 
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For e' < e" contained in and 5', 6" G (0, 1), define 

'.f{n,9",n iif{n,9",S")<g{n,9',6'), 

0", <5") + gin, 9', 5')] if f{n, 9", 5") > gin, 9', 5') 

gin,9',6') if fin,9" ,6") < gin,9' ,5'), 

r , 5") + gin, 9', if fin, 9", 5") > gin, 9',S') 



fin,9',9",6',6") = 



gin,9',9",5',5") = 



Our general principle for constructing multistage test plans and their properties can be described 
by Theorem [1] as follows. 

Theorem 1 Let Ui = 0(C) G (0, 1), A = 0(C) G (0, 1) /or z = 1, • • • , m - 1 and Om = Po = 0. 
Define Hi = maxjaj : i < j < m} and /3j = max{/3j : < j < i} for i = 0, 1, • • • ,m — 1. 
Suppose that is a ULCE of 6. Suppose that the maximum sample size Ug is no less than n 
which is the minimum integer n such that fin, 6'-, j3i) > g(n, 0[, Oj) for i = 1, - ■ ■ ,m — 1. Define 
fe,i = fine, 9'-, ai,f3i) and gi^i = gine, 9[, O'l, on, Pi) for i = !,■■■ ,m-l. Define 



1 ^f Oe< 

^ gi,i-i < 1^ fi,i where 2 < i < m — 1, 

m if9e>g£,m-i, 

else 



(3) 



for I = 1, - ■ ■ ,s. The following statements (I)- (VI) hold true for m > 2. 

(I) PrlReject J^o \ 9} is non- decreasing with respect to 9 £ &q. 

(II) Fr{Reject J^m-i \ 9} is non-increasing with respect to 6 £ ©m-i- 

(III) Vi{Reject J^i \ 9} < s(aj + ^j) for any 9 e Oi and i = 0,1,- , m - 1. 

(IV) For < i < m — 1, Pr{Accept M'i \ 0} is no greater than soi and is non- decreasing with 
respect to 9 £ & no greater than 9'-. 

(V) For < i < m — 2, Pr{Accept \ 9} is no greater than s/3i+i and is non-increasing with 
respect to 9 £ & no less than 9'/_^_i. 

(VI) Assume that E,[e''^] exists for any t G M and that ipn = ^'^^ ^' is an unbiased and 
unimodal-likelihood estimator of 9, where Xi, X2, ■ ■ ■ are i.i.d. samples of X. Assume that rig is 
equal to n. Then, lim<^_j.o Pr{Reject J^i \ 9} = for any 9 £ 0i and i = 0,1, - ■ ■ ,m — 1. 

Moreover, the following statements (VII), (VIII) and (IX) hold true for m > 3. 
(VII) 

Pr{Reject M \ 9} < Pr{Reject ^i,e<a\a} + Pr{Reject J^i,d>b\b}, 
PT:{Reject M\9]> P^{Reject J^i, 6 < a \ b} + PriReject Jifi,d>b\a} 

for any 9 G [a, b] C and 1 < i < m — 2. 

(VIII) Pr{Reject J% and J^m~i \ 9} is non- decreasing with respect to 9 £ Oq and is non- 
increasing with respect to 9 £ 0m-i- 
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(IX) Pi{Reject .3% and | 9} is no greater than s x maxjoj : 1 < i < m — 2} for ^ Oq 

and is no greater than s x max{/3j : 2 < i < m — 1} for 9 € ©m.^i- 

See Appendix |B] for a proof. 

In order to develop test plans with simple stopping boundary, we define multivariate functions 



fcin,e,5)^ 
9c{n,e,6) = 




otherwise 

niin{z e I^^ : <^„(z, 9) < 6, z > 9} if {^^„(v„, 9) < 5, v„ > ^} ^ 0, 
oo otherwise 



forn e N, e 0, (5 e (0, 1), where '^„(z, 9) = infpgM E^^'^"^'^)]. Moreover, define 
f(n,9\9'\S',S")- 



fc{n,9",5") iif,{n,9",5")<g,{n,9',5'), 
9", 5") + <5')] if /c(n, (5") > 0', 5') 



Un,9\9",S',S") 



9c{n,9',5') iif,{n,9",5")<g,{n,e',S'), 
^[f,{n,9",6")+g,{n,9',6')] ii f,{n,9\5") > g,{n,9' ,5') 



for 9' < 9" in 0, 6', 5" G (0, 1) and n G N. 

Our sampling schemes and their properties can be described by Theorem [2] as follows. 

Theorem 2 Let ai = 0(C) G (0, l),/3i = 0{Q G (0, 1) /or i = 1, • • • , m - 1 and = /3o = 0. 
Define cti = maxja^ : i < j < m} and 13^ = max{/3j : < j < i} for i = 0,1, ■ ■ ■ ,m — 1. Suppose 
that Kle^-^] exists for any t G M and ipn = ^'^^ ^' is an unbiased and unimodal-likelihood estimator 
of 9. Suppose that the maximum sample size Ug is no less than n which is the minimum integer 
n such that fc{n, 9'- , Pi) > gdn, 9[, ai) for i = 1, - ■ ■ ,m — 1 . Define decision variable Di by 
for I = !,■■■ ,s with f^^i = fj^n^, 9[, 9'1 , ai,Pi) and ge^i = gdng, 9-, 9-, ai,Pi) for i = !,■■■ ,m-l. 
Then, the same conclusion as described by statements (I)~(IX) of Theorem{l\ holds true. 

See Appendix O for a proof. 

Theorem [1] and [2] establish the groundwork for bisection risk tuning. In the design of multi- 
stage test plans, for risk tuning purpose, we recommend choosing = mm{(^6i-i, 1} and /3j = 
minjCJj, 1} for i = 1, • • • ,m — 1. According to statement (VI) of Theorem [H PrjReject Jifi \ 9} 
tends to as C tends to 0. This implies that we can ensure ([2]) by choosing a sufficiently small 
risk tuning parameter Clearly, every value of C determines a test plan and consequently its 
performance specifications such as average sample number (ASN) and risks of making wrong de- 
cisions. Intuitively, under the constraint of risk requirements, the risk tuning parameter ^ should 
be chosen as large as possible in order to reduce the sample number. To achieve such an ob- 
jective, it is a critical subroutine to determine whether a given is sufficient to ensure the risk 
requirement ([2]). Since there may be an extremely large number or infinite parametric values in 
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U™Q 01, it is essential to develop an efficient method to check the risk requirement ([2]) without 
exhaustive computation. For this purpose, statements (I), (II) and (VI) of Theorem [T] can be very 
useful. As a consequence of statement (I), to check if Pr{Reject J% \ 0} < 5o for any 9 £ 0q, 
it suffices to check whether PrjReject J% \ 9'i} < 6o is true. By virtue of statement (II), for 
purpose of determining whether PrjReject J^m-i \ 0} < ^m-i for any 6 G 0m-i, it is sufficient to 
check if Pr{Reject J^m-i \ G'm-i} — ^m-i is true. For i E {1, • • • ,m — 2}, to determine whether 
Pr{ Reject Jifi \ 9} < 6i for any 9 £ 0i, we can apply the bounding results in statement (VI) of The- 
orem [1] and the Adaptive Maximum Checking Algorithm (AMCA) established in [1]. Therefore, 
it is clear that we can develop an efficient subroutine to determine whether a given guarantees 
the risk requirement ([2]). Now, let C be the maximum number in the set {10 x 2~* : i G N} such 
that the risk requirement ^ is satisfied when the risk tuning parameter ^ assumes value Such 
number ^ can be obtained by using the subroutine to check the risk requirement ([2]). Once ^ is 
found, we can apply a bisection search to obtain a number as large as possible from interval 
[C, 2^) such that the risk requirement ([2]) is satisfied when the risk tuning parameter ( assumes 
value C*- 

The above bisection risk tuning technique can be straightforwardly extended to control the 
following error probabilities: 



For this purpose, statements (IV) and (V) of Theorem [T] can be used to develop efficient method of 
checking the above risk requirements. In a similar spirit, by virtue of statements (VII) and (VIII) 
of Theorem [H the control of PrjReject J^q and J^m-i \ 9 £ 0o U 0m-i} can be incorporated 
in the bisection risk tuning technique. As can be seen from above discussion, a critical idea in 
the tuning technique is to avoid exhaustive computation by making use of monotonicity of error 
probabilities with respect to 9. 

2.3 Recursive Computation 

As will be seen in the sequel, for most multistage sampling schemes for testing parameters of 
discrete variables, the computation of the OC functions involve probabilistic terms like I'r{Ki £ 
J^i, i = !,••• ,£}, ^ = 1,2, where Kg = ^"=iXi and ^ is a subset of integers. The 
calculation of such terms can be performed by virtue of the following recursive relationship: 



Pr{ Accept 
Pr{ Accept ^ 
Pr{ Accept ^ 
Pr{ Accept ^ 



9 £ 0j}, 
9 £ 0j}, 

9 £ e,}, 

9 £ ©,}, 



0<i<j<m— 1 



< J < i < m - 1 



0<i<j-2<j<m-l 



0<j<i-2<i<m-l 



PT{Ke+i = h+i- K,£ je-, i = !,■■■ ,i} 

Fi{Ke = kf, Ki£j(<, i = !,■■■ ,£-1} Pr{Kf+i - Ke = h+i - kg} 
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where the computation of probabihty Pi{K£^i — Ki = k^^i — kg} depends on specific problems. 
In the context of testing a binomial parameter p, we have 

Pr{i^,+l -Kg = ki+i -h\p]= ~ - p)ne+^-n,-k,+^+k,_ 

\ke+i - kej 

In the context of testing a Poisson parameter A, we have 

[(n^+i - ne)Xf^+^-''^ exp(-(n^+i - n^)A) 



Pr{ir^+i - Kg = ke+i - ke \ X} 



(%i - kg)] 



In the context of testing the proportion, p, of a finite population of size using multistage 
sampling schemes to be described in Section I3.6.2| we have 

/ pN-ke \ / N-ne-pN+ki \ 
r T,^ TV- ; ; I T \ki^i-k() \ne+i-ni-k£+i+ki) 

PrjA^+i -Ke = kg+i - kg \ p} = . 

It should be noted that the domain truncation technique to be described in subsection 12.41 can be 
used to significantly reduce computation. 



2.4 Domain Truncation 

In the design and analysis of multistage sampling schemes, the associated computational com- 
plexity can be high because the domain of summation or integration is large. The truncation 
techniques recently established in [2] have the power to considerably simplify the computation by 
reducing the domain of summation or integration to a much smaller set. The following result, 
quoted from [2], shows that the truncation can be done with controllable error. 

Theorem 3 Let ai,bi,Ui,Vi,r]i, i = 1, - ■ ■ ,k be real numbers. Suppose that Pr{ui < Zi < Vi} > 
1 — Tfi for i = ,/c. Then, P' < Pr{aj < Zi < hi, i = 1, - ■ ■ ,k} < P' + where 

P' = Pr{a'j < Zi < b'^, i = 1, • • • ,k} with a[ = maxjoj, tij} and b'- = min{6j, Vj} for i = 1, - ■ ■ ,k. 



3 Construction of Sampling Schemes 

In this section, we shall discuss the applications of the fundamental principle described in the 
previous section to the design and analysis of multistage testing plans. 



3.1 One-sided Tests 

In order to infer from random samples Xi , X2 , • • • of X whether the true value of 9 is greater or 
less than a certain number G 0, a classical problem is to test one-sided hypothesis J% : 6 < iD 
versus Jifi : 6 > This problem can be cast in the general formulation ([1]) with m = 2, 0o = 
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{9 £ & : 9 < -d} and 0i = {9 £ & : 9 > -d}. To control the probabilities of making wrong 
decisions, it is typically required that, for a priori numbers a, /3 G (0, 1), 

Pr {Reject .J^o \ 0} < a for any 9 £ Oq, (4) 
Pr {Accept J^o \ 0} < ^ for any 9 £ 0i (5) 

with 0Q = {9 £ ©0 : 9 < 9o} and 0i = {9 £ ©i : 9 > 9i}, where 9q and 9i are numbers in such 
that 9o < i) < 9i. The inequalities in (jU and ([5]) specify, respectively, the upper bounds for the 
probabilities of committing a Type I error and a Type II error. Clearly, the interval (^o, ^i) is an 
indifference zone, since there is no requirement imposed on probabilities of committing decision 
errors for 9 £ {9q,9i). 

Applying Theorem [1] to the special case of m = 2, we have the following results. 

Corollary 1 Let aoi/^i £ (0, 1). Suppose that ip^ ^ ULCE of 9 and that the maximum sample 
size Ug is no less than n which is the minimum integer n such that > g{n,9o,ao). 

Define 

1 ifOe<l{n(>,9o,9i,ao,/3i), 
Df=l2 ifde>g{7ie,9o,9i,ao,^i), 
else 

for i = 1, • • • ,s. Then, Pr{Accept Ji^Q \ 9} < sj3i for 9 £ & no less than 9i, and PT{Reject \ 
9} < sao for 9 £ & no greater than 9o. Moreover, Fy:{Accept .3% \ 0} is non-increasing with 
respect to 9 £ & such that 9 ^ (^Oi^i)- 

Applying Theorem [2] to the special case of m = 2, we have the following results. 

Corollary 2 LetaQ,f3i £ (0, 1). Suppose that fc{n,9i, f3i) > gc{n,9Q,ao) if n is sufficiently large. 
Suppose that the maximum sample size Us is no less than n which is the minimum integer n such 
that fc{n, 9i, Pi) > gdn, 9q, ao). Suppose that is an unbiased and unimodal-likelihood estimator 
of 9 for £ = !,••• ,s. Define 



D, 



1 ifOi< f_^{ni,9o,9i,ao,f3i), 

2 ifei>g^{ne,9o,9i,ao,Pi), 
else 



for i = 1, - ■ ■ ,s. Then, the same conclusion as that of Corollary{l\ holds true. 

In Corollaries [1] and [21 we can choose ao = min{^Q,l}, /3i = min{^/3, 1} for risk tuning 
purpose. 
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In order to develop a class of test plans with OC functions being monotone in the overall 
parameter space 0, we shall introduce multivariate functions 



F{n,e,5) 



max{z e I^^ : F^^ {z, 9) < S} if {F^^ {ip,^,e) < 5} 0, 
-oo otherwise 



min{z e I^^ : (z, 0) < 5} if {G<^„ {if,,, 9) < (5} 7^ 0, 
00 otherwise 



G{n,9',9",S',S") 



G{n,9,5) : 

for n G N, 6* G 0, 5 G (0, 1) and 

f F{n, 9", 5") if F(n, 9", 5") < Gin, 9', 5'), 

F{n,9',9",5',5")^ I L ^ ^ ^ 

\ \[F{n, 9", 5") + G{n, 9', 5')] if F{n, 9", 5") > G(n, 9', S') 

G{n, 9', 6') if F{n, 9", 6") < G{n, 9', 5'), 

^[F{n,9",6")+Gin,9',5')] iiF{n,9",6") > G{n,9' ,5') 

for 6' < 9" in and 5' ,6" G (0, 1). Moreover, we need to make use of the concept of monotone 
likelihood ratio. The likelihood ratio is said to be monotonically increasing with respect to if, 
for arbitrary 9' < 9" in 0, the Hkelihood ratio f V" '"' i ah (or ''''' t''"' '"""E for the 

continuous case) is monotonically increasing with respect to Lp^. 

Now we are ready to describe a new class of test plans by Theorem [4] as follows. 

Theorem 4 Let ao,/3i G (0,1). Suppose that </5„ is a ULCE of 9 and that the likelihood ratio is 
monotonically increasing with respect to y^. Suppose that the maximum sample size Ug is no less 
than n which is the minimum integer n such that F{n,9i, (3i) > G{n,9o,ao). Define 



Dp 



1 ■ifG£<E.{ne,9o,9i,ao,(3i), 

2 ifde>G{ni,9o,9i,ao,(3i), 
else 



for i = 1, • • • ,s. Then, Pr{Accept Jifo \ 6} < s(3i for 9 £ @ no less than 9i, and Pr{Reject J% \ 
9} < sao for 9 £ & no greater than 9q. Moreover, Fi{Accept | 9} is non-increasing with 
respect to 9 £ Q. 

See Appendix [D] for a proof. 
3.2 Two-sided Tests 

In order to infer from random samples Xi , X2 , • • • oi X whether the true value of 9 is equal to a 
certain number 9i G 0, it is a frequent problem to test two-sided hypothesis J% : 9 = 9i versus 
: 9 ^ 9i. To control the probabilities of making wrong decisions, it is typically required that, 
for a priori numbers a,/3 G (0, 1), 

Pr{Reject I 6*1} < a, (6) 
Pr {Accept J^o \ 9} < p for G such that 9 i {9o, ^2) , (7) 
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where Oq and 62 are two numbers in such that Oq < 9i < 62. The inequahties in ([6]) and ^ 
specify, respectively, the upper bounds for the probabihties of committing a Type I error and a 
Type II error. Since there is no requirement imposed on probabihties of committing errors for 
6 £ {60, 9i) U {61, 62), the union of intervals (^O; ^1) U (^i, ^2) is referred to as an indifference zone. 
Applying Theorem [T] to test hypotheses 

with indifference zone {0q,9i) U {01,62), we have Pr{Reject T-Lq and T-L2 \ 0} = Pr{ Accept J% \ 9} 
and the following results follow immediately. 

Corollary 3 Let aQ,ai, f^i, /32 € (0, 1). Suppose that (f^ is a ULCE of 9 and that the maximum 
sample size rig is no less thann which is the minimum integer n such that f[n,9i, j3i) > g{n,9Q,aQ) 
and f{n,92, (32) > g{n,9i,ai). Define 



1 ifg{ni,9o,9i,ao,l3i) < 9^ < lini,9i,92,ai, 132), 

2 ifOi < f{ni, 9q, 6*1, ao, ^1) or 9^ > g{ni, 9i, 6^2, ai, /32), 
else 



for i = 1, • • • ,s. Then, Fr{Accept J% \ 9} < s x max{ao, /32} for 9 £ @ such that 9 ^ {9q, 6*2), 
and VT{Reject J^Q \ 9i} < s{ai Moreover, Pr{Accept \ 9} is non- decreasing with respect 

to 9 £ & no greater than 9q and is non-increasing with respect to 9 £ Q no less than 92- 

Applying Theorem[2]to test hypotheses Hq, Hi and ■H2 with indifference zone (^O; ^i)U(^i, 92), 
we have the following results. 

Corollary 4 Let aQ,ai, f3i, P2 £ (0,1)- Suppose that 

fc{n,9i,Pi) > gc{n,9o,ao), fc{n,92, P2) > gc{n,9i,ai) (8) 

if n is sufficiently large. Suppose that the maximum sample size Ug is no less than n which is 
the minimum integer n such that ^ is satisfied. Suppose that 9^ is an unbiased and unimodal- 
likelihood estimator of 9 for i = 1, - ■ ■ ,s. Define 



1 ■ifgcine,9o,9i,ao,/3i) <9i< f_J(ne,,9i,92,ai, (32), 

2 if9i, < l^{ni,9o,9i,ao,(3i) or9i> > gc{ni,9i,92,ai, ^2) 
else 



for i = 1, - ■ ■ ,s. Then, the same conclusion as that of Corollaryl^ holds true. 

In Corollaries [3] and m we can choose ao = /32 = inin{C/3, 1} and ai = /?i = min{^,l} for 
risk tuning purpose. 
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3.3 Tests of Triple Hypotheses 

As compared to two-sided tests, a more realistic formulation is to test three hypotheses : 6 < 
9i, J^i : 9 = Oi and ^2 ■ > 9i, where 9i £ &. To control the risks of committing decision 
errors, it is typically required that, for prescribed numbers 60, 61,62 G (0, 1), 

Pr {Accept J^o \ 9} > 1 - 60 foi 9 e @ such that 9 < 9o, 
Pr {Accept \ 9i} > 1 - 61, 

Pr {Accept \ 9} > 1 - 62 for G such that 9 > 92, 

where ^nd 02 are numbers in such that 9q < 9i < 92- Clearly, {9q,9i) U (0i,02) is an 
indifference zone. Applying Theorem [1] to test hypotheses Ha : < ^ Hi : < < 

and 7^2 : ^ > ^i-i^ with indifference zone (^O; ^1) U (^i) ^2)) we have the following results. 

Corollary 5 Let oq, ai, (3i, 132 G (0,1). Suppose that (f^ is a ULCE of 9. Suppose that the 
maximum sample size Ug is no less than n which is the minimum integer n such that f{n, 9i, > 
g{n,9o,ao) and f{n,92, /32) > gin,9i,ai). Define 



Dp 



1 ifOe<l{ne,9o,9i,ao,(3i), 

2 ifg{ne,9o,9i,ao, f3i) < 61 < /(n^, 6'i, 6*2, ai, /32), 

3 ifei>g{ni,9i,92,ai,/32), 
else 



for i = 1, - ■ ■ ,s. Then, the following statements hold true. 

(i) Pv{Reject J% \ 9} < sxma-K{ao,ai} for9 G no greater than 9o. Moreover, Fi{Reject J% 
9} is non- decreasing with respect to 9 & & no greater than 9q. 

(a) Pr{Reject \ 9} < sx max{/3i, /32} for 9 & & no less than 92- Moreover, Pi{Reject | 
9} is non-increasing with respect to 9 & & no less than ^2- 

(Hi) Fr{RejectJ^i \ 9i} < s{ai + A). 

Applying Theorem[2]to test hypotheses Uq : 6 < Hi : <e < and ^.2 ■ > 

with indifference zone {9q,9i) U {9i,92), we have the following results. 

Corollary 6 Let aQ,ai, I3i, (32 G (0,1). Suppose that 

fc{n,9i,(3i) > gc{n,9o,ao), /c(ri, 6*2, /32) > 9c(n, 6*1, ai) (9) 

if n is sufficiently large. Suppose that the maximum sample size Ug is no less than n which is 
the minimum integer n such that ^ is satisfied. Suppose that Oi is an unbiased and unimodal- 
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likelihood estimator of 9 for £ = 1, - ■ ■ ,s. Define 

1 if < l^{ne, 00,01, ao,^i), 

2 ifgc{ni,9o,Oi,ao,(3i) <9i< fjni,9i,92,ai, (32), 

3 ifdi >g^{ni,9i,92,ai,l32), 
else 

for i = 1, - ■ ■ ,s. Then, the same conclusion as that of Corollaryl^ holds true. 

In Corollaries [S] and El we can choose = mm{C6o,l}, ai = /3i = min{^,l}, /32 = 
mm{(d2, 1} for risk tuning purpose. 

3.4 Interval Tests 

It is a frequent problem is to test hypothesis J% : 9 G [^1,^2] versus J^i : 9 ^ [^1,^2]- For risk 
control purpose, it is typically required that, for two prescribed numbers a, /? G (0, 1), 

Pr {Reject J% \ 9} < a for G such that 9 G [9", ^2], 
Pr {Accept J% \ 9} < P for ^ G such that 9 i (9'^,9'i) , 

where 9\,9'l are parametric values in such that 9'^ <9\ < 9'{ < 6*2 < ^2 < Q'i- Since there is no 
requirement imposed on probabilities of committing decision errors for 9 G {9'i,9'() U (^2)^2)) the 
union of intervals, {9[, 9'1) U {9'2, ^2)) referred to as an indifference zone. 

In view of the fact that the objective of the test is to decide whether the parameter 9 falls 
into a specified interval, such a test is called an "interval test" . 

Applying Theorem [1] to test hypotheses Hq : 9 < 9i, Hi : 9i < 9 < 92 and 7i2 : 9 > 92 with 
indifference zone {9[, 9'{) U (^21 ^2)' we have Pr{Reject Tio and ^2 I = Pr{Accept J^q} and the 
following result follows immediately. 

Corollary 7 Let ai,a2, Pi, (^2 £ (0,1). Suppose that Lp^ is a ULCE of 9 and that the maximum 
sample size Ug is no less than n which is the minimum integer n such that f{n,9'l, Pi) > g[n, 0^, ai) 
and f{n, 92, P2) ^ gin, 92, 0:2)- Define 



\ tfg{ne,9[,9'l,ai,Pi)<d,<l{ne,9'2,9'^,a2,P2), 
2 tfde<l{ne,9[,9'l,ai,pi) or 0, > ^(n,, 0^', 02, /?2) 
else 



for i = 1, - ■ ■ ,s. Then, the following statements hold true. 

(i) VT{Accept .J^o\0} < s X max{ai, /?2} for 9 e @ such that 9 ^ i9[,92] 

(ii) FT{RejectJ% \ 9} < s{a2 + Pi) for 9 e & such that 9 G [9'{,9'2]. 
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(in) Pr{Accept \ 9} is non- decreasing with respect to 9 £ & no greater than 9[ and is 
non-increasing with respect to 9 £ @ no less than Moreover, 

Fv{Reject JTq \ 9} < Fr{Reject Jifo, < a \ a} + PT{Reject J%,d>b\b}, 
Fr{Reject J^o \ 9} > Fr{Reject J%,d<a\b} + Fr{Reject J^o,e>b\a} 

for any9e [a,b] C [e'/,^^]n0. 

Applying Theorem [2] to test hypotheses Uq : 9 < 9i, Ui : 9i < 9 < 92 and n2 : 9 > 9^ with 
indifference zone (0'^, 9^) U (^2' ^2)1 have the following results. 

Corollary 8 Lei qi, 02, /32 G (O?!)- Suppose that 

fc(.n,9'l,f3i)>g,{n,9[,ai), fc{n,9lp2)>gc{n,9'^,a2) (10) 

if n is sufficiently large. Suppose that the maximum sample size Ug is no less than n which is 
the minimum integer n such that MO) is satisfied. Suppose that 6i is an unbiased and unimodal- 
likelihood estimator of 9 for i = 1, - ■ ■ ,s. Define 



Di = { 



1 ifg,{n,,9[,9'i,ai,f5i)<e,<lin,,9'^,9la2,h)i 

2 ifee<f^ine,9[,9lau/3i) orde>g,{ne,9'^,9'^,a2,P2), 
else 



for i = 1, - ■ ■ ,s. Then, the same conclusion as that of Corollary^ holds true. 

In Corollaries [T| and El we can choose 02 = Pi = min{Ca, 1} and ai = /32 = min{C/3, 1} for 
risk tuning purpose. 

3.5 Tests of Simple Hypotheses 

In some situations, it may be interesting to test multiple simple hypotheses J^i : 9 = 9i for 
i = 0,1, ■ ■ ■ ,m — 1. For risk control purpose, it is typically required that, for prescribed numbers 
6i G (0,1), 

Pr {Accept J^i \ 9i} > 1 - Si, i = 0, 1, • • • , m - 1. 
Applying Theorem [1] to the following hypotheses 

no:9<l3l, ni:^l<9<^2, nm-2 ■■ < 9 < Ura-l ■ 9 > 

with = ^'-1+^' ^ i = 1, • • • ,m — 1 and indifference zone U™^^(^i_i, 0j), we have the following 
results. 
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Corollary 9 Let ai,/3i £ (0, 1) for i = 1, • • • ,m — 1 and am = /5o = 0. Define oli = max{aj : 
i < j < m} and fi^ = max{/3j : < j < for z = 0, 1, • • • , m — 1. Suppose that is a ULCE 
of 9 and that the maximum sample size ris is no less than n which is the minimum integer n 
such that f{n,0i,(3i) > g{n,6i_i,ai) for i = 1, ■ ■ ■ ,m - 1. Define fe,i = f{ne,6i^i,9i,ai, /3i) and 
9e,i = gi^eT^i-i^Gi^ Oii, l^i) for i = 1, ■ ■ ■ ,m—l. Define decision variable by ^ for i = 1, ■ ■ ■ ,s. 
Then, FT{Reject J^i \ 6i} < s{ai + for i = 0,1, - ■ ■ , m — 1. 

Applying Theorem[2]to hypotheses Hi, i = 0,1, - ■ ■ , m—1 with indifference zone U™^^(0i_i, 6i), 
we have the following results. 

Corollary 10 Let Oi, /3i G (0, 1) for i = 1, ■ ■ ■ ,m — 1 and Om = /3o = 0. Define Hi = max{ CKj : 
i < j < m} and /3j = max{/3j ■ < j < i} for i = 0,1, ■ ■ ■ ,m — 1. Suppose that 

fc{n,ei,l3i)> gc{n,ei-i,ai), i = l,--- ,m-l (11) 

if n is sufficiently large. Suppose that the maximum sample size Ug is no less than n which is 
the minimum integer n such that is satisfied. Define fi^i = f ^{n£,6i-i,9i,ai, Pi) and gi^i = 
gdne, Gi-i^f^i, Oii, f3i) for i = 1, ■ ■ ■ ,m — 1. Define decision variable Di by (0j for I = 1, • • • ,s. 
Suppose that 6^ is an unbiased and unimodal-likelihood estimator of 9 for i = I,-- - ,s. Then, 
Fr{Reject M\6i] < sioli + /or i = 0, 1, • • • ,m-l. 

In Corollaries [91 and 1101 for risk tuning purpose, we recommend choosing Qj = min{^5j_i, 1} 
and j3i = min{C(5i, 1} for i = 1, • • • , m — 1. 

3.6 Applications 

In this section, we shall demonstrate that the general principle proposed above can be applied to 
develop specific test plans for common important distributions. To apply our general method, we 
need to choose appropriate estimator = ^p{Xi, • • • , X„) for 9 and investigate whether has 
the following properties: 

(i) is a ULE of 9; 

(ii) ifn converges in probability to 9; 

(iii) is an unbiased estimator of 9; 

(iv) The likelihood ratio is monotonically increasing with respect to 

(v) For 9' < 9" in and S' , 6" e (0, 1), /c(n, 9", 6") is no less than g^n, 9', 6') if n is sufficiently 
large. 

3.6.1 Testing a Binomial Proportion 

Let X be a Bernoulli random variable with distribution Pr{X = 1} = 1 — Pr{X = 0} = p £ 
(0,1). To test hypotheses regarding p based on i.i.d. samples Xi,X2,--- of X, we shall take 
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(f^ = ip{Xi^ • • • , Xn) = — - as an estimator of p. With such a choice of estimator, it can be 
shown that, for n £ N,p £ (0,1), J £ (0,1), 



Fin,p,S)^ 



i X max {fc e Z : ^to Cl)p'i^ - pT~" < ^, < fc < n} for n > 



ln{l-p) 



i X 

71 


max 


— oo 




i X 

n 


mill • 


oo 




i X 

n 


max • 


— OO 




i X 

n 


min 1 



ln(5) 



for n < 



ln(.5) 



for ,i< M£) 



1(5) 



forn<i(^i- 
lor n <, i„(i_p) 

x^^Z:j:t,{-)p^{l-pr-^<5,np<k<n} forn > , 



and 



fcin,p,6) = 



max{z e [0,p] : ^b(z,p) < ^} for n > , 
-oo for n < I '/"/'^'* s 

In(l-p) 

min{0 e [p, 1] : ^b(^,p) < ^p-} for ??. > 



oo for n < 



where 



zlnf + (l-z)lni3f for ze (0,1), 
^b(2;,p) = \ lii(l - p) for z = 0, 

Inp for z = 1. 

Moreover, it can be verified that the estimator (p^ possesses all properties described at the 
beginning of Section 13.61 This implies that all testing methods proposed in previous sections are 
applicable. 



3.6.2 Testing the Proportion of a Finite Population 

It is a frequent problem to test the proportion of a finite population. Consider a population of 
units, among which there are Np units having a certain attribute, where p £ & = {jf : i = 
0, 1, • • • , N}. The procedure of sampling without replacement can be described as follows: 

Each time a single unit is drawn without replacement from the remaining population so that 
every unit of the remaining population has equal chance of being selected. 

Such a sampling process can be exactly characterized by random variables Xi, • • • , X]\f defined 
in a probability space (0, Pr) such that Xi denotes the characteristics of the i-th sample in 
the sense that = 1 if the i-th sample has the attribute and Xi = otherwise. By the nature 
of the sampling procedure, it can be shown that 

P.{X. v I P} ^ (^fj J („ "^^^^ ^ j C) ] (12) 
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for any n £ {1, • • • ,N} and any Xi £ {0, 1}, i = I, ■ ■ ■ ,n. By virtue of (|12p . it can be shown 
that Pr{Xi = 1} = 1 — Pr{Xi = 0} = p € 0, which imphes that Xi, ■ ■ ■ ,Xn can be treated 
as identical but dependent samples of a Bernoulli random variable X such that Pr{X = 1} = 
1 — Pr{X = 0} = p € 0. Recently, we have shown in [1] that, for any n G {1, • • • , A^}, the sample 
mean y3„ = ^^=^ — - is a ULE for p £ &. Clearly, (p„ is not a MLE for p £ @. Hence, we can 
develop multistage testing plans in the framework outlined in Section 12.11 With the choice of 
ip^ = i^i^ — 1 as the estimator of p, it can be shown that 



G{n,p, S) 
g{n,P,S) = 



{keZ: Eto {'f){\--f)/0 <S,0<k<n} for (^7^) < SO, 

for {--n > 60 

•i X min{fc G Z : ^t, (f < S, < k < n} for < S^), 

for > ^(^) 

e Z : Eto rf)r„"-f )/C) < 5, < fc < np} for ^7^^) < J^), 

for ("7") > SO 
{fc e ^ : EL. ) ("--f )/(^) <S,np<k<n} for ) < ^ C^), 

for n > ^C!) 



for n G {1, • • • , N}, p £ @ and (5 G (0, 1). Clearly, cp^ converges in probability to p and thus is 
a ULCE of p. Moreover, it can be verified that the likelihood ratio is monotonically increasing 
with respect to (f^. This implies that the general results described in the previous sections can 
be useful. 

In order to develop test plans with simple stopping boundary, we define multivariate functions 



fc{n,p, 5) 



2{n,p,5) 



max{z e I^^ ■.C{n,z,p) < S, z < p} if {C(n, ¥5„,p) < S, V„ < p} 7^ 

-00 otherwise 

minjz G /^^ : C{n, z,p) < S, z > p} if {C{n, V„,p) < S, <^„ > p} ^ i 

00 otherwise 



for n e N,p G 0, (5 G (0, 1), where 

(?) 



for z = 1, 



C{n,z,p) = { (Np^(N-Np^^ (13) 
Vn.An-nz; loT z £ : k £ Z, < k < Tl} . 



\ nz J \ n — nz J 



Moreover, define 

fSn,P,p",S\6") 



Ic{n,p",5") iif,{n,p",5") < gcin,p',S'), 

i[/,(n,p",<5") + .gc(n,p',<5')] if /,(n,p", <5") > ,9e(n,p', <5') 

9c{n,p',S') if < g^{n,p' ,S'), 

^[Mn,p'\S")+g,{n,p',S')] \i Un,p" ,5") > g,{n,p' ,5') 

for p' < p" in 0, 6', 5" £ (0, 1) and n G N. 



g^n^p ,p ,d ,0 ) 
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For the multi-hypothesis testing problem stated in the introduction with 6 replaced by p, we 
have the following results. 



Theorem 5 Let ai, /3i G (0, 1) for i = 1, • • • ,m — 1 and = /3o = 0. Define Ui = maxjoj : i < 
j < m} and (3^ = max{/3j : < j < i} for i = 0, 1, • • • , m — 1. Suppose that the maximum sample 
size Ug is no less than n which is the minimum integer n such that fcin,p'l , f3i) > gc{n,p'-,ai) 
for i = I,-- - ,m, - I. Define fi^i = [Jni>,p'^,p'l ,ai, I3i) and gi^i = g^{ne,p[,p'l ,ai, /3i) for i = 
1, • • • , m - 1. Define ^ v>„, ^'=; ^' and 



Dp 



1 if Pt< fe,i, 

i if ge,i^i <Pi< fi,i where 2<i<m-l, 

m if Pi> ge,m-i, 

else 



(14) 



for i = 1, - ■ ■ ,s. The following statements (I)-(V) hold true for m > 2. 

(I) VT{Reiect \ p} is non- decreasing with respect to p £ ©o- 

(II) Fr{Reject J^m-i \ p} is non-increasing with respect to p £ 0m-i- 

(III) FT{Reject Jifi \ p} < s(aj + /3,j) for any p £ 0i and i = 0,1, ■ ■ ■ ,m — 1. 

(IV) For < i < m — 1, Pr{Accept J^i \ p} is no greater than sai and is non- decreasing with 
respect to p £ & no greater than p[ . 

(V) For < i < m — 2, Fic{Accept M'i \ p} is no greater than s/3j+i and is non-increasing with 
respect to p £ Q no less than p'l_^i ■ 

Moreover, the following statements (VI), (VII) and (VIII) hold true for m > 3. 
(VI) 

Fr{Reject Ml \ p} < Pv{Reject J^i, p < a \ a} + Fr{Reject Ml, p>b\b}, 
FiiReject Ml\p]> F^{Reject M,P<a\h] + F^{Reject J^i, p>b\a} 

for any p £ [a, b] C 0^ and I < i < m — 2. 

(VII) Pr {Reject J% and Mm-i \ p} is non- decreasing with respect to p £ Oq and is non- 
increasing with respect to p £ ©m-i ■ 

(VIII) Fr{Reject Mq and Mm.-i \ p} is no greater than s x maxja^ : 1 < i < m — 2} for p £ Oq 
and is no greater than s x max{/3j : 2 < i < ?n — 1} for p £ ©m-i. 

It should be noted that p[, p'l in Theorem [5] play similar roles as 9\, O'l in the introduction in 
defining the requirement of risk control. Accordingly, Oi in Theorem [5] has the same notion as Qi 
in introduction with parameter 9 identified as p. 

Theorem [5] can be shown by using a similar argument as that for Theorem [1] and the following 
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results obtained by Chen [3], 

Pr I ^'=^ <z\p^ < C{n, z,p) for 2 G 1^ : A: G Z, np < /c < n| , (15) 

Pr I ^^=^ > z \ < C{n, z, p) for z e |- : /c G Z, < /c < npj (16) 

where p G and C{n,z,p) is defined by (fT3|) . Since has a hypergeometric distribution, 

the above inequahties and provide simple bounds for the tail probabilities of hypergeo- 
metric distribution, which are substaintially less conservative than Hoeffding's inequalities [7]. 

3.6.3 Testing the Parameter of a Poisson Distribution 

Let X be a Poisson variable of mean A > 0. We shall consider the test of hypotheses regarding A 
based on i.i.d. random samples Xi,X2, ■ ■ ■ of X. Choosing </3„ = ^ — ' ^ estimator for A, 
we can show that, for n G N, AG (0, oo), 6 G (0, 1), 



F(n,A,<5) 



i X max j/j e Z : J^Lo ^"^^^f < <5, fc > o| for n > 



-A ■ 
r ln{i5) 

-OO lor n < 



G{n,\,6) = - X min|/e e Z -.J^^ — -[ ^ 1 -(5, fc > l| 

i X max j/j e Z : X;Lo ^"^^^f"'' < '5, < < nAj for n > 



ln(5) 
-A ' 

OO tor n < 

1 .,^..J,_..^M)'e-"^ 



/(n,A,(5) 

g(n, A, (5) = - X min fc e Z : V ^^^^^^^^ > 1 - f^, k > n\ 



i=0 



and 



max{z e [0,A] : ^p(z,A) < ii^} forn > 

} 



/c(n, A,(5) : 

(7c(fi, A, (5) = min z e [A, od) : ^p(z. A) < 



for n < 



ln(i) 



n 



where 



^p{z, A) 



z-X + zln{^) forz>0, 
—A for z = 0. 



Moreover, it can be verified that the estimator (p^ possesses all properties described at the be- 
ginning of Section 13.61 This implies that all testing methods proposed in previous sections are 
applicable. 

3.6.4 Testing the Mean of a Normal Distribution with Knov^n Variance 

It is an important problem to test the mean, /x, of a Gaussian random variable X with known 
variance a based on i.i.d. random samples Xi,X2,--- of X. Choosing — — - as an 
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estimator of ^u, we have 



^ 2s ^ Zs 

F{n, fi, 6) = f{n, fi,6) = fi - a G{n, fi, 6) = g{n, ij,6) = fi + a ^ 



for n G N, /U € (—00,00), 6 G (0,^). It can be shown that the estimator possesses all 
properties described at the beginning of Section OJ^ and consequently, all testing methods proposed 
in previous sections can be used. 

3.6.5 Testing the Variance of a Normal Distribution 

Let X be a Gaussian random variable with mean fj, and variance o"^. In many applications, it is 
important to test the variance based on i.i.d. random samples Xi,X2, ■ ■ ■ of X. 

In situations that the mean fi of the Gaussian variable X is known, we shall use <p„ = 
i X]"=i(^j ~ m)^ estimator of a. It can be verified that 



F{n, a,S)=aJ^, Gin, a,5)=a J 



f{n, cr, (5) = cr min ^ 1, \ ^"'^ K ^ gin, a,5) = a max I 1, 



Xn.l-(5 



,2 



,2 



f{n,a,S) = a min <( 1, y " ^'^ > , g{n,a,S) = a max <| 1, J^!L_LLJ. 



for n G N, a £ (0,oo), 5 G (0,1). Moreover, it can be verified that the estimator (p^ possesses 
all properties described at the beginning of Section 13.61 This implies that all testing methods 
proposed in previous sections are applicable. 

In situations that the mean fi of the Gaussian variable X is unknown, we shall use (p.^ = 
\/ n J27=ii-^i ~ ^n)'^, where X„ = ^'=^ ^' , as an estimator of cr. To design multistage sampling 
schemes for testing a, we shall make use of the observation that (f^ is a ULCE of a and relevant 
results described in previous sections. By the definition of it can be readily shown that 

t 

forn G N, a G (0,oo), 5 G (0, 1). Let a = 0(C) G (0, 1), (3 = 0(C) G (0, 1) and < cr' < a". Let 
n(C) be the minimum integer n such that f{n, a" , (3) > g{n,a' ,cx). We can show that 

f 21nQ! _ 21n/3 _ 1 1 ^ A 1\ 
n C < max <^ ^ + 1, ^ r + 1, r } = 0[ln-] . 17 

To show (fT7|) . note that f{n,a",P) > g{n,a',a) is equivalent to 

max{n,xLi,i-a} < f j min{?^> xLi,/?}- (18) 

Let Z he a chi-square variable of n — 1 degrees of freedom. Then, Pr{Z > Xn-i i-al ~ ^ 
Pr{Z < Xn-i /j} — Lemma[7]in Appendix [E) we have 

(n-l)/2 

exp (1 r 1 < OL 



Pr<jZ>(n-l)(-)[>< 



a" 



a" 
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and thus Xn-i,i-a < — 1) (^) < ^ (^) P™'^^*^^'^ ^'^^^ 

n — 1 In Q 

> 



2 - 1 _ £l + In ^ 
Similarly, by Lemma [7] in Appendix [Ej we have 



P,^Z<{n-l)[^]}< 



a'- 



77 e^P 1 



(n-l)/2 

</3 



and thus Xn-i /3 — ~ 1) j ^ provided that 

n — 1 In /3 1 

— — > ; r, n > r- 

2 -1-^+lnfi' 1-^ 

It can be seen that a sufficient condition for (1181) is 



21na 21n/3 1 

n>max{ ^ ^ + 1, . _ , + 1, 



1-^+ln^ +ln^ 1 



It follows immediately that (I17p is true. Making use of (I17p . we can show that, in the context 
of testing multiple hypotheses regarding a with our proposed multistage testing plan, the risk 
of making wrong decisions can be made arbitrarily small by choosing a sufficiently small C > 
0. Specifically, if we identify parameter Q in Theorem [T] as o", using (I17p . we can show that 
lim^_>o Pr{Reject | 0} = for any 9 £ 0i and i = 0, 1, • • • , m — 1. 

Our method for the exact computation of the OC function Pr{ Accept J% \ a} is described as 
follows. Since Pr{ Accept J% | it} = 1 — Pr{ Reject J% | a}, it suffices to compute PrjReject J% \ 
a}. By the definition of the testing plan, we have 

s 

Pr {Reject JTq | a} = ^ Pr {<^„^ > 6,, a, < < 6j, 1 < j < ^ | <t} . (19) 
e=i 

If we choose the sample sizes to be even numbers ni = 2ki, i = 1, • • • ,s for the case of known 
variance and odd numbers n£ = 2k£ + 1, i = I,-- - ,s for the case of unknown variance, we can 
rewrite (1191) as 



Pr {Reject ^okl-EP^E^.^y (7) ' ^ (?) ' ^ E ^ f (^) for 1 < , < £ | a , 

e=l [q=l \ ^ g=l \ / J 

(20) 

where Zi, Z2, • • • are i.i.d. exponential random variables with common mean unity. To compute 
the probabilities in the right-hand side of (|20p , we can make use of the following results established 
by Chen [T]. 
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Theorem 6 Let 1 = ko < ki < k2 < ■ ■ ■ be a sequence of positive integers. Let Q = zq < zi < 
Z2 < ■ ■ ■ he a sequence of positive numbers. Define w(0, 1) = 1 and 



w{r, i) (zi - ZrY' 



4=1 



{q-i)\ 



kr < q < kr+i, r = 0, 1 



for £ = 1,2, ■ ■ ■ . Let Z\, Z2, ■ ■ ■ be i.i.d. exponential random variables with common mean unity. 
Then, 

Y,Z,> zj fori = !,■■■ ,4 =e-^^E 

q=l J q=l 

for i = 1,2, ■ ■ ■ . Moreover, the following statements hold true. 
(I) 



S «j < H ^9 < ^3 /or j = 1, • • • , J 
[ 9=1 

1=1 I g=l 



Y,Vr\Y,Z,>m,., for 3 = !,■■■ ,^ 



where Ai = [oi], Bi = [61] and 



A 



r+l 



Ap af, + l/2r--lxl 

Br &r+l-^2'— 1x1 



Br 



+1 



i=l I q=l 



Br Ctr+1-^2'— 1x1 
Ar 6r + l-^2'— 1x1 

r-1 



r= 1,2,. 



where 12^-1 xi represents a column matrix with all 2^ elements assuming value 1. 
(II) 



{kj fcf+i 
"'i <^Zq < bj /or j = 1, • • • , ^Zq> bi+i 
q=l q=l 

^ Pr i ^ > [S], J /or J - 1 ,•••,€+ 1 

i=l I g=l 



2^-1 r fe. 

^ Pr <^ 5^ > [F],,, /or J = 1, •••,£ + 1 



where E 
(III) 



bi+il2i-i 



xl 



and F 



Be be+il2e-i 



xl 



< ^ Z, < 6j /or j = 1, • • • , XI ^9 < ^^^+1 

9=1 g=l 

<! < X < ^'j /ori = 1, • • • ,n - Pr <^ a, < X < 6^ for j = 1, 
9=1 I I 9=1 



9=1 
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3.6.6 Testing the Parameter of an Exponential Distribution 

Let X be a random variable with density function f{x) = \e.~e for < x < cx), where is a 
parameter. In many applications, it is important to test the parameter 6 based on i.i.d. random 
samples Xi,X2,--- oi X. We shall use = — - as an estimator for 9. Accordingly, for 
i = 1, - ■ ■ ,s, the estimator of 9 at the ^-th stage is 6e = = — -■ It can be shown that 



F{n, e, 6) = — , G{n, 0, S) = , 

Zn In 

f{n,0,S) = 9 mill 1 1, ^^^| , gin, 0,6) = 6 maxjl, ^^^^^| 

for n G N, 6* G (0, oo), 5 E (0,1). Since the estimator (f^ possesses all properties described 
at the beginning of Section 13.61 all testing methods proposed in previous sections are applica- 
ble. Moreover, it is possible to exactly compute the OC function Pr{ Accept ,3^q \ 9}. Since 
Pr{ Accept | ^} = 1 — Pr{Reject \ 9}, it suffices to compute Pr {Reject \ 9}. By the 
definition of the stopping rule, we have 

s 

Pr {Reject ^ | 0} = ^ Pr > bi, aj <de<bj, 1 < j < ^ | 6i| . (21) 

Let Zi,Z2,--- be i.i.d. exponential random variables with common mean unity. Then, we can 
rewrite (j2ip as 

Pr {Reject Jif(> \ 6} ^J2^Jf2 Z, > ne (j) , n, (^) < < n, f'^) for 1 < j < f | flj . (22) 



To evaluate the probabilities in the right-hand side of (j22p . we can make use of the results in 
Theorem [6j 

3.6.7 Life Testing 

In this section, we shall consider the problem of life testing using the classical exponential model 
[5]. Suppose the lengths of life of all components to be tested can be modeled as i.i.d. random 
variables with common probability density function frit) = Aexp(— At), where the parameter 
A > is referred to as the failure rate and its reciprocal is referred to as the mean time between 
failures. In reliability engineering, it is a central issue to test the failure rate A based on i.i.d. 
random samples Xi,X2, ■ ■ ■ of X. 

In practice, for purpose of efficiency, multiple components are initially placed on test. The test 
can be done with or without replacement whenever a component fails. The decision of rejecting, 
or accepting hypotheses or continuing test is based on the number of failures and the accumulated 
test time. Here it should be emphasized that the accumulated test time is referred to as the total 
running time of all components placed on test instead of the real time. 

The main idea of existing life-testing plans is to check how much test time has been accu- 
mulated whenever a failure occurs. The test plans are designed by truncating the sequential 
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probability ratio tests (SPRT). There are several drawbacks with existing test plans. First, the 
existing test plans are limited by the number of hypotheses. Currently, there is no highly effect 
methods for testing more than two hypotheses. Second, when the indifference zone is narrow, the 
required accumulated test time may be very long. Third, the specified level of power may not 
be satisfied due to the truncation of SPRT. Four, the administrative cost may be very high in 
the situations of high failure rate, since it requires to check the status of test whenever a compo- 
nent fails. To overcome such drawbacks, we can apply the general principle described in previous 
sections to the life testing problems. We proceed as follows. 

Let Z\ > 0. Let Z be the number of failures in a time interval of length A. Then, Z is a 
Poisson variable of mean value \A. Define X = ^. The distribution of X is determined as 

Pr|x = -| = ^^^, . = 0,1,2,.... 

Let Xi = where Zi is the number of failures in time interval [{i — I) A, iA) for i = 1, 2, ... . 
Then, Xi, X2, ■ ■ ■ are i.i.d. samples of X. Therefore, we can cast life testing problems in our 
general framework of multistage hypothesis tests with sample sizes ni,n2, - ' ' ^t^s- Accordingly, 
the testing time is = ngA, i = I, ■ ■ ■ , s. We shall take y3„ = — - as an estimator of A. It 
follows that, for i = 1, - ■ ■ ,s, the estimator of A at the i-th. stage is taken as 

- Yl'iii^i YTiLx'Z'i Number of failures in [0, t^) 
Xl = (p[Xi,- ■ ■ , A„ j = = — = . 

n£ n^A t£ 

Clearly, is a ULCE of A; (p^ is an unbiased estimator of A; the likelihood ratio is monotonically 
increasing with respect to Hence, the estimator (f^ possesses all the properties described at 
the beginning of Section 13.61 This implies that all testing methods proposed in previous sections 
are applicable. 

It can be seen that all tests described above depend on, A, the unit of time used to convert 
the continuous time process to a discrete time process. In applications, it may be preferred to use 
the test derived by letting Z\ — 0. This can be accomplished as follows. Define 

Number of failures in [0, t) 



/°(i,A,<5) = 



t 

max{2 e I^^ : F^^ {z, A) < S} if {F^^ (ift, X) < S} ^ 0, 
—00 otherwise 

min{z e I^^ : G^^ (z, A) < 6} if {G^^ (<p„ A) < ,5} ^ 0, 
00 otherwise 

max{z e I^^ : F^^ (z, A) < 6, z < X} if {F^^ {ip^, X) < (5, tp^ < A} 7^ 0, 
-00 otherwise 

niin{z G I^^ : G^^(z,A) < 5, z > X} if {G<^^(v„A) < 6, (ft > A} ^ 0, 
00 otherwise 
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and 




max{z € I^^ : 'gt{z. A) < 5, z < A} if {"^t(<Pt, A) < (5, < A} 7^ 0, 

~oo otherwise 

min{z e /^^ : "it^z, A) < 5, z > A} if A) < <5, > A} ^ 0, 

00 otherwise 



where -^4(2, A) = inf^eR E[e''('^'-^)]. It can be shown that 

\ X max |fc e Z : X;Lo ^^^^^^f^ < <5, fc > o| for t > 



F0(i,A,,5) 



ln(5) 
-A ' 

-00 for i < 



G°{t, A, <5) = ^ X min <j fc e Z : ^ ^^^^^^ > I - S, fc > 1 



i=0 

; |fc e Z : ^^^Q (tA)^£l!i < J, < fc < a| for t > 

for t < 




g°{t, A, (5) = ^ X min <j fc e Z : ^ > 1 - S, k > tX 

i = y 



-A ■ 
-A 



and 



fcit,X,S) 



max{z G [0,A] : ^p(z,A) < fort>M|), 
OD tor t < -^Y- 



j°{t,X,S) = minjz e [A, 00) : ^p(z,A) < . 



If the sample sizes ni, - ■ ■ , rig are chosen as the ascending arrangement of ah distinct elements of 
{\Cr-e n]}, then we can determine the limit of as Z\ — )• as follows. 

Recall that n is the minimum integer n satisfying conditions like F{n, X" ,5") > G{n, X' ,6') 
or f{n,X",5") > g{n,X',6') or fc{n, X" ,6") > gdn, X' ,6'), where A" > A" are numbers defining 
indifference zones and 5', 6" depend on the risk tuning parameter Hence, the limit of nZ\ can 
be determined by virtue of the following observations: 

lim A X min{n G N : F{n, X" , 6") > G{n, A', 6')} = mm{t : X",5") > X',5')}, 

lim A X min{n G N : /(n, A", 6") > g{n, A', 6')} = mm{t : f{t, A", 6") > g^{t, A', 6')}, 
A^O 

lim A X min{n G N : fc{n, A", 6") > g^n, A', 5')} = mm{t : A", 6") > g°{t, A', 5')}. 
A^O 

Since t(fif is a Poisson variable of mean value Xt, the above functions can be exactly evaluated. 
Clearly, once the limits of testing time are determined, we have a multistage test plan which 
depends on the risk tuning parameter. We can evaluate the risk of such a limiting test plan. If 
the risk requirement is not satisfied, then we can change C and find the corresponding limiting 
test plan. This process can be repeated until a satisfactory test plan is found. 
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4 Tests for the Mean of a Normal Distribution with Unknown 
Variance 

In this section, we shall focus on tests for the mean, /i, of a Gaussian variable X with unknown 
variance o"^ based on i.i.d. samples Xi, X2, ■ ■ ■ of X. Our objective is to develop multistage 
sampling schemes for testing hypotheses regarding 9 = ^, which is the ratio of the mean to the 
standard deviation. 



4.1 General Principle 

A general problem regarding = ^ is to test m mutually exclusive and exhaustive composite 
hypotheses: 

: 9 G ©0, J^l ■ 9 e ©1, . . . , J^rn-l '■ 9 G ©m-l, 

where ©0 = (—00,^1], ©m-i = (^m-i)C«) and ©j = (^j, 6*^+1], i = !,••• ,m — 2 with 9i < 92 < 
■ ■ ■ < 9m^i. To control the probabilities of making wrong decisions, it is typically required that, 
for pre-specified numbers 6i G (0, 1), 

Pr{Accept I 6*} > 1 - (5i "^9 G 9i, i = 0, 1, • • • , m - 1 

with 00 = {-00, 9[], 0m~i = and 0i = for i = 1, • • • , m - 2, where 9'^, 9'1 

satisfy 9[ < 9i, 9'^^^ > 9^^i and 9i^i < 9'/_^ <9[<9i< 9'1 < 9'-^^ < 9i+i for i = 2, • • • , m - 2. 

Theorem 7 Suppose that Oj = 0{C) G (0, 1) and Pi = 0{C) G (0, 1) for i = 1, ■ ■ ■ ,m — 1. Let n 
be the minimum integer n such that {9" — 9'-)\/n — 1 > tn-i,ai + tn-ifii for i = 1, ■ ■ ■ ,m — 1. Let 
2 < Hi < n2 < ■ ■ ■ < ns = n be the sample sizes. Define 



ft 



V^e—l 



if{9'l - 9-)y/ne - 1 < tne-l,ai + tne-l,l3i, 



for i = 1, - ■ ■ , m — 1. Define 



9e^ 



-^ni — , O^Tij — \ , — — , 

ni y ni cr„^ 

1 forOii < fis, 

i for gi^i^i < 6e < fe^i where 2 < i < m — 1, 
m fordi > ge,m-i, 
^ else 

for £ = 1, - ■ ■ ,s. Then, the following statements (I)-(V) hold true for m > 2. 



(23) 
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(I) Fr{Reject J% \ 9} is non- decreasing with respect to 9 £ Oq. 

(II) Pic{Reject J^m-i \ 9} is non-increasing with respect to 9 £ 0m-i- 

(III) Pv{Reject M'i \ 0} is no greater than 6i for any 9 G 0i and i = 0,1, • • • ,m — 1 provided 
that is sufficiently small. 

(IV) For < i < m — 1, Fi{Accept J^i \ 9} is non- decreasing with respect to 9 no greater than 

(V) For < i < m — 2, Vi{Accept | 9} is non-increasing with respect to 9 no less than 



1" 



Moreover, the following statements (VI), (VII) and (VIII) hold true for m > 3. 
(VI) 

Pi{Reject ^i\9} < Pi{Reject ^i, 6 < a \ a} + Pv{Reject J^i,d>b\b}, 
Pr{Reject .M- \ 9} > Pi{Reject < a | 5} + Pi{Reject Mi,e>h\a} 

for any 9 G [o, b] C ©j and I < i < m — 2. 

(VII) Pi{Reject and M'm-\ \ ^} is non- decreasing with respect to 9 £ 0q and is non- 
increasing with respect to 9 € 0^-1 ■ 

(VIII) For any pre-specified 6 G (0, 1), Pic{Reject J% and J^m-i \ 0} is no greater than 6 for 
9 £ 0qU 0m-i provided that Q is sufficiently small. 

See Appendix [E] for a proof. By virtue of Theorem [7] and similar ideas as described after 
Theorem m we can develop bisection risk tuning techniques for designing multistage test plans. 
For risk tuning purpose, we can choose ai = C,5i-i and /3j = C5i with C, G (0, 1) for i = 1, • • • , m — 1. 

4.2 Applications 

In this section, we shall study the applications of Theorem[7]to specific testing problems. Specially, 
the following Sections 14.2. 11 BTX^ and H. 2. 31 are devoted to the discussion of hypotheses concerned 
with the comparison of the mean of Gaussian variable X with a pre-specified number 7. Such 
issues can be formulated as problems of testing hypotheses regarding -d = ^^-p-- To develop 
concrete testing plans, we make use of the following statistics 



— 5 <^no — \\ ; ) J-i — — 



for £ = 1, • • • , s. 



4.2.1 One-sided Tests 



In many situations, it is an important problem to test hypotheses : < versus : i? > 0. 
To control the risks of committing decision errors, it is typically required that, for prescribed 
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numbers a, /? G (0, 1), 

Pr {Accept ^ | t9} > 1 - a for < -e, 
Pr {Accept | i9} > 1 - /3 for i? > e, 

where the indifference zone is (— e,e). Applying Theorem [7] to the special case of m = 2, we have 
the following results. 

Corollary 11 Let a = 0(C) G (0, 1) and (5 = 0(C) G (0, 1). Let n be the minimum integer n 
such that i,i_i,a + i,i-i,/3 < 2e-s/n — 1. Zei 2 < ni < n2 < ■ ■ ■ < rig = n be the sample sizes. Define 
ae = e^/ni^-tn^-i,i3, be = -e\/n£ - I for i = 1, • • • ,s-l, and a, = bs== *"°'''''2*"°'''^ • 

Define 

{1 forfi<ai, 
2 forfe>bi, 
eke 

/or ^ = 1, • • • , s. Then, the following statements hold true. 

(i) Vi {Accept I t?} is Zess i/ian /? for •& no less than e if C > is sufficiently small, 
(a) Pr {Reject \ ■!?} is less than a for no greater than —e if C > is sufficiently small. 
(Hi) The OC function Pr {Accept J% \ i}} is monotonically decreasing with respect to {} ^ 
(— oo, —e\ U [e, oo). 

For the sake of risk tuning, we recommend choosing ol = C,a and (3 = where C, G (0, 1). 
4.2.2 Two-sided Tests 

It is a frequent problem to test hypotheses : = versus Mi : i? 7^ 0. To control the risks of 
committing decision errors, it is typically required that, for prescribed numbers a, /3 G (0, 1), 

Pr {Accept M\^}>l-a for i? = 0, 
Pr {Accept JTi | i?} > 1 - /3 for > e, 

where the indifference zone is (— e,0) U (0, e). Applying Theorem [7] to test hypotheses T-Lq : 
i?<— |, "Wi:— |<^9<f and %2 '■ "& > ^ with indifference zone (—£,0) U (0,e), we have 
Pr{Reject T-Lq and I "&} = Pr{Accept Mq \ -d} and the following results follow immediately. 

Corollary 12 Let ol = 0{C,) G (0, 1) and /3 = 0(C) G (0, 1). Let n be the minimum integer n 
such that tn^i.oc + tn-i.p < £\/n — 1. Let 2 < ni < n2 < ■ ■ ■ < rig = n be the sample sizes. Define 
ai = ey/ne - 1 -t^^-i,^, be = tn^-i,^ for 1 = 1,- ■■ ,s - 1, and as ^ bs = t^s-i.^^-t^s-ua + _ 1. 
Define 

fl for\n\<at, 
Di^h for\fe\>be, 
I else 
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for £=!,••• ,s. Then, the following statements hold true. 

(i) Fr {Accept J% \ i?} is less than fi for any ■& G (— oo,— e] U [e,oo) if ( > is sufficiently 
small. 

(a) Pr {Reject \ ■!?} is less than a for = if ( > is sufficiently small. 
(Hi) The OC function Vx {Accept \ t?} is monotonically increasing with respect to "d G 
(— oo, — e] and is monotonically decreasing with respect to "& £ [e,oo). 

For the purpose of risk tuning, we recommend choosing a = ^ and /3 = C/3, where C £ (0, !)• 
4.2.3 Tests of Triple Hypotheses 

In many applications, it is desirable to test three hypotheses 

^ : < 0, JTi : 1? = 0, ^2 : i9 > 0. 

To control the risks of committing decision errors, it is typically required that, for prescribed 
numbers a, (3 £ (0, 1), 

Pr {Accept | t?} > 1 - /3 for t9 < -e, 
Pr {Accept J^i \ '&} > 1 - a for i9 = 0, 
Pr {Accept | i?} > 1 - /3 for > e, 

where the indifference zone is (— e,0) U (0,e). Applying Theorem [7] to test hypotheses T-Lq : 'd < 
— |, Til : — I < i9 < I and 7i2 : i? > | with indifference zone (— e, 0) U (0, e), we have the following 
results. 



Corollary 13 Let a = 0{() G (0, 1) and (3 = 0{() G (0, 1). Let n be the minimum integer n 
such that tn-i.a + iji-1,/3 < £Vn — 1. Let 2 < ui < n2 < ■ ■ ■ < Us = n he the sample sizes. Define 
at = £yjni - \ -tni-\fi, be = tni-i,a for 1 = 1,- ■■ ,s-l, and = 6., = + ^V^s - 1- 

Define 

1 forT(<~bi, 

2 for\fe\<ae, 

3 forT(>bt, 
else 

for £ = !,••• , s. Then, the following statements hold true. 

(i)VT {Accept J^Q I -i?} is greater than 1 — /3 for any -d G (— oo, — e] if Q > is sufficiently small. 
Moreover, Vi {Accept Mq \ i?} is monotonically decreasing with respect to 'd £ (— oo,— e]. 

(a) Ft {Accept \ i}} is greater than 1 — /3 for any G [e, oo) z/ C > is sufficiently small. 
Moreover, Pr {Accept \ is monotonically increasing with respect to £ [£,oo). 

(Hi) Pr {Accept | iD} for ■!? = is greater than 1 — a if C > is sufficiently small. 

For the purpose of risk tuning, we recommend choosing a = ^ and /3 = where C £ (0, 1). 
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4.2.4 Interval Tests 

In some situations, it is desirable to test hypothesis : G [^1,^2] versus J^i : 9 ^ [6*1, 02]- For 
risk control purpose, it is typically required that, for two prescribed numbers a, (3 £ (0, 1), 

Pr {Reject J% \ 6} < a for G such that 6 G [9'l, 62], 
Pr {Accept J% \ 6} < /3 for ^ G G such that 6 {9[, O'^) , 

where 9[ < 9i < 6'( < 62 < 62 < 02- Since there is no requirement imposed on probabilities of 
committing decision errors for 6 G {9'i,9'() U (^2' ^2)) the union of intervals, {9'i,6'() U (^2' ^2)' 
referred to as an indifference zone. 

Applying Theorem [7] to test hypotheses Tio : 9 < 0i, Tii : 9i < 9 < 02 and n2 : > 02 with 
indifference zone {0[,0'() U (6*2,^2)1 '^^ have Pr{Reject Tio and ^2 I 9} = Pr{Accept Jifo \ 9} and 
the following results. 

Corollary 14 Let Ui = 0(C) G (0, 1) and Pi = 0(C) G (0, 1) for i = 1,2. Let n he the minimum 
integer n such that {9'1 — 9'^)^Jn — 1 > tn-i,ai +ir!.-i,ft for i = 1,2. Let 2 < ui < n2 < ■ ■ ■ < Ug = n 
he the sample sizes. Define 



2y/ni-l 




2^ni-l 

for i = 1,2. Define 

1 if9i,\ <0i< fi^2, 
Dp ={2 ifdi < fe^i ordi > gi^2, 
else 

for i = 1, - ■ ■ ,s. Then, the following statements hold true. 

(i) VT{Accept J^o\9] < fi for 9 ^ {O'l^O'i) if C is sufficiently small, 
(a) Fr{Reject | ^} < a for G [^1,^2] if C is sufficiently small. 

(Hi) Pr{Accept \ 9} is non- decreasing with respect to 9 no greater than 0[ and is non- 
increasing with respect to no less than 02- Moreover, 

Vi{Reject < PT{Reject J^Q,6<a\a] + FT{Reject J%,d>h\b}, 

Fr {Reject J% \ 0} > Fr {Reject Jifo, 6 < a \ b} + Fr {Reject d>b\a} 

for any 9 € [a,b] C [^;',^^]. 

We can choose 02 = f3i = C^^ and ai = /32 = C/3 with ^ G (0, 1) for risk tuning purpose. 
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4.2.5 Tests of "Simple" Hypotheses 

In some situations, it may be interesting to test multiple simple hypotheses =^ : 6 = 9i for 

1 = 0, 1, • • • ,m — 1. For risk control purpose, it is typically required that, for prescribed numbers 
6i G (0,1), 

Pr {Accept J^i \ 9i} > 1 - 5i, i = 0,1, ■ ■ ■ ,m - 1. 
Applying Theorem [7] to test the following hypotheses 

no:e<^l. Hi : < 9 < 1^2, nm-2 ■ < e < ^.m-l, nra-1 : 9 > 

with = — -, i = 1, - ■ ■ ,m — \ and indifference zone {9i^i,9i), we have the following 
results. 

Corollary 15 Let = 0(C) G (0,1) and A = 0(C) G (0, 1) /or i = 1, • • • , m - 1. Let n be 

the minimum integer n such that {9i — 9i^i)\/n — 1 > tn_i,Q.. + in-i.ft for i = 1, - ■ ■ ,m — 1. Let 

2 < n\ < n2 < ■ ■ ■ < lis = n he the sample sizes. Define 

ifi^i — (^i-ll^/ni — 1 < tni-l,ai + tni-l,l3i^ 
if {Gi — 9i^i)-^n£ — 1 > tni~lMi + *n£-l,ft 

^/(^i — Oi^l)^/ni^^ < tni-l,a, + tne-l,l3i, 
if{(^i - Oi-l)V''^e — 1 > in£-l,a, + inf-l,/3i 

for i = 1, - ■ ■ ,m - I. Define fi^i = f(ni,9i-i,9i,ai, Pi) and gi^i = g{ni,9i-i,9i,ai, j3i) for i = 
1, • • • , m — 1. Define decision variable Di by [23\) for £ = 1, - ■ ■ ,s. Then, Pi{Reject J^i \ 9i} < 5i 
for z = 0, 1, • • • , m — 1 if C is sufficiently small. 

For risk tuning purpose, we recommend choosing CKj = C^i-i a^id f3i = (6i ioi i = 1, •• • ,m—l, 
where ( £ (0, 1). 

5 Conclusion 

In this paper, we have established a new framework of multistage hypothesis tests which applies 
to arbitrary number of mutually exclusive and exhaustive composite hypotheses. Specific testing 
plans for common problems have also been developed. Our test plans have several important 
advantages upon existing tests. First, our tests are more efficient. Second, our tests always 
guarantee prescribed requirement of power. Third, the sample number or test time of our tests 
are absolutely bounded. Such advantages have been achieved by means of new structure of testing 
plans and powerful computational machinery. 
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A Preliminary Results 

We need some preliminary results. The following Lemmas [T] and [2] have been established in [T]. 

Lemma 1 Pr{Fz{Z) < a} < a and Pr{Gz{Z) < a} < a for any random variable Z and positive 
number a. 

Lemma 2 Let S be an event determined by random tuple {Xi, • • • , Xj.). Let '^{Xi^ ■ ■ ■ , Xj.) be a 
ULE of 9. Then, 

(i) Pr{(f I 0} is non- increasing with respect to 9 ^ & no less than z provided that S C 

(ii) Prlff I 0} is non- decreasing with respect to 9 & Q no greater than z provided that £ C 

MXi,-- - ,x,)>z]. 

Lemma 3 Let Xi,X2, ■ ■ ■ ,Xj. be a sequence of samples of random variable X parameterized by 
^ E 0. Let Z = (p{Xi,--- ,Xj.) be an unbiased and unimodal-likelihood estimator of 9. Suppose 
that the moment generating function ./^ {p, 9) = E[e''^] of Z exists for any p G M. Define '^{z, 9) = 
infp6Ke-''^E[e^'^]. Then, 

Pr{Z < z} < <^(z,6'), yz<9 
Fr{Z > z} <'rf{z,9), \/z>9. 

Moreover, 'rf{z, 9) is non- decreasing with respect to 9 no greater than z and is non-increasing with 
respect to 9 no less than z. Similarly, ^[z,9) is non- decreasing with respect to z no greater than 
9 and is non-increasing with respect to z no less than 9. 

Proof. By the convexity of function and Jensen's inequality, we have infp>o E[e''^'^~^'*] > 
infp>o e/''^[^-^l > 1 for > z. In view of infp<o E[e''(^-^)] < 1, we have 'i^{z,9) = infp<o E[e/'(^-^)] 
for 9 > z. Clearly, "^(z, 9) = infp<o e~'^^K[e'^^] is non-decreasing with respect to z less than 
9. Since Z is a ULE of 9, we have that Efe''^^"^)] = e-^^E[e^^] = e"^^ /^"^^ Pr{e/'^ > u}du is 
non-increasing with respect to 9 > z for p < and thus ^{z, 9) is non-increasing with respect to 
9 greater than z. 

Observing that infp>o E[e''(^"^)] < 1 and that infp<o E[e^(^^^)] > infp<o e^'^l^^^l > 1 for 
6* < z, we have 'i§'{z,9) = infp>o E[e^(^^^)] for 9 < z. Clearly, '6'{z,9) = infp>o e-''^E[e''^] is 
non-increasing with respect to z greater than 9. Since Z is a ULE of 0, we have that E[e''*'^~^''] = 
e-~^^ Pr{e^^ > u}du is non-decreasing with respect to 9 for p > and consequently, '(^(z, 9) 
is non-decreasing with respect to 9 smaller than z. 

Making use of the established fact infp<o E[e''(^~'^)] = '^(z, 9) and the Chernoff bound Pr{Z < 
z} < infp<oE[e''(^-^)], we have Pr{Z < z} < 'tf{z,9) for z < 9. Making use of the established 
fact infp>oE[e''(^"^)] = 'tf{z,9) and the Chernoff bound Pt{Z > z} < infp>o E[e''(^-^)], we have 
Pr{Z > z} < ^{z, 9) for z > 9. This concludes the proof of Lemma [3l □ 
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B Proof of Theorem [T] 



For arbitrary parametric values < in by the assumption that converges in probabihty 
to e, we have that Pr{(p„ > \ 60} < Pr{|<^„ - ^o| > I ^0} ^ and Pr{if.^ < \ 

^1} < Pr{|(^„ — ^i| > ^^2^° I ^i} — 7- as n — )• 00. This shows that n exists and is finite. 

Since Fg^{z,9) = Pr{0^ < ^ | ^} = 1 — Pr{0^ > z \ making use of Lemma [2] and the 
assumption that Oi is a ULE of 9, we have that F'g^iz, 0) is non-increasing with respect to S 0. 
Similarly, since Gq^{z, 9) = Pr{0£ > z \ 9} = 1 — Pr{0^ < z \ 9}, making use of Lemma [2] and the 
assumption that On is a ULE of 9, we have that Gg^{z, 9) is non-decreasing with respect to G 0. 

To show statement (I), notice that {Reject Mq} C {0 > 0^} as a consequence of the definition 
of the test plan. Hence, statement (I) is proved by virtue of Lemma [2j 

To show statement (II), notice that {Reject C {0 < 9'l^_i] as a consequence of the 

definition of the test plan. Hence, statement (II) is proved by virtue of Lemma 

To show statement (III), we first claim that Pr{l < < i | ^} < /3,j for < i < m — 1 
and 9 G 0,. Clearly, {B, < = {6, < l{n,,9'j,9] , a„ p^)} C {0, < fine,9'J , ^,)} for 1 < 

j < i. Since Fg^{z,9) is non-decreasing with respect to z, we have {9i < f{ni,9j,f3j)} C {Oi < 
9'^,F^^{de,9'^) < l3j} C {Fg^{di,9'^) < for l<j<i. Recalling that Fg^{z,9) is non-increasing 
with respect to 9 £ @ and invoking Lemma (TJ we have 

Pr{0, < fej I 9} < Pr{Fg^ {0,, 9]) < | 9} < Pr{Fg^ (0,, 9) < (3j \ 9} < (3j < (24) 

for 1 < i < i and 6* G ©j. For i = 0, it is clear that Pr{l < De < i \ 9} = < for 9 e &o. 
For i = 1, by virtue of ([Ml), we have Pr{l < De < i \ 9} = Pr{0£ < \ 9} for 9 G ©i. 

For 2 < i < m — 1, define S = {j : gej~i < fej, 2 < j < i} and let r be an integer such that 
r assumes value 1 if (S* is empty and that r G 5, fi_r = ^^^{fej '■ j € S} if S is not empty. 
It follows from that Pv{l < Dg < i \ 9} < Pr{0£ < /^^^ \ 9} < for 2 < i < m - 1 
and 9 G 0i. This proves our first claim. Next, we claim that Pr{i + 2 < Di < m \ 9} < Ui 
for < i < m - 1 and 6* G ©j. Clearly, {9^ > gej} = {Oe > g{ne,9'j,9'^ ,aj, ^j)} C {d/, > 
g{ni,9'j,aj)} for i < j < m — 1. Since Gq^{z,9) is non-increasing with respect to z, we have 
(Oe > g{ne,9'j,aj)} Q {0, > 9'^, 0-^^(0^,9'^) < aj} C {G^^(ee,9'^) < a,} for i < j < m - L 
Recalling that G^ {z-,9) is non-decreasing with respect to ^ G and invoking Lemma [H we have 

Pr{§, > g,j I 9} < Pr{Gg^(?,, 9'^) < a, \ 9} < Pr{Gg^(0,, 9) < a, | 9} < a,- < a, (25) 

for i < j < m — 1 and 9 G ©j. For i = m — 1, it is evident that Pr{i + 2 < Dg < m \ 
= < Om-i for 9 G ©m-i- For i = m — 2, making use of ([25]) . we have Pr{i + 2 < 
Dg < m \ 9} = ¥i{6g > ge^m-i I ^} ^ am.-2 for 9 G ©m-2- For < i < m — 3, define 
5" = {j : gej-i < f£,j, i + 2<j<m — I}, and let r be an integer such that r assumes value 
m — 1 if 5 is empty and that r G 5, ge^r^i = mm{g£j„i : j G 5} if 5" is not empty. It follows 
from dlSI) that Pr{i + 2 < Dg < m \ 9} < Pr{0^ > gtr~i \ 9} < Ui foi < i < m - 3 and 
9 G ©j. This proves our second claim. Making use of these two established claims, we have 
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Pr{ Reject Jifi \ 9} < E£=i[Pr{l < De < i \ 9} + Pr{i + 2 < De < m \ 6}] < + Pi) for 

i = 0,1, ■ ■ ■ ,m — 1 and 9 £ 0i. This establishes statement (III). 

Statements (IV) and (V) can be shown by virtue of Lemma [2] and the observation that 
{Accept J^i} {9'^ < < 9l_^i} and that {Accept J^i} is determined by the random tuple 
(Xi, ■ ■ ■ , Xn) as a consequence of the definition of the test plan. 

We now want to show statement (VI). Observing that G^^{z, 9) is non-increasing with respect 



to z, we have that g{n,9[,ai) < ' ^ ' if 
ULE for 9, it follows from Lemma [3] that 



+ 



-A 



Pr <^ > 



?f + 0', 



%) < Oj. Since = — - is an unbiased 



< 



+ 



if n > 



In(ai) 



, where C{z,9) = ml p^-^¥,[eP^'^ ^•']. On the other hand, observing that F^^(z,9) 



is non-decreasing with respect to z, we have that f{n, 9'-', pi) > 
(fn is an unbiased ULE for 9, it follows from Lemma [3] that 



-ifF^J^,en<ft- Since 



-,0'! 



Pr jv^n 



< 



9'' + 9' 



if n > 



In(ft) 



2 ' V 1^ r - 2 

. Therefore, f{n,9'/,/3i) > g{n,9[,ai) if 
n > max 



< 



e 



< A 




It follows from the definition of n that 



n < 



max 



max • 



In(aj) 



ln(/3, 



'e{i,--- ,m-i} \ c('^^ 9'.) C{^'^^^'^ ^" 




2 '''i/ ^\ 2 

Invoking the established statement (III), we have that, as C — )■ 0, 

1 



O In 



Pr{Reject M \ 9} <n {ui + < O \\n - J 0(C) ^ 

for any 9 £ 0i and i = 0,l,-- - ,m — 1. This proves statement (VI). 

To show statement (VII), by the definition of the test plan, we have that {Reject J^} is 
determined by the random tuple (Xi,--- ,Xn)- Moreover, for any numbers a and b such that 
9- < a < b < 9'^^-^, we have that {Reject J^} = {Reject 9 < a} U {Reject Jifi, 9 > 
b} and {Reject J^i, 6 < a} n {Reject J^i, > b} = 9, which imply that Pr{Reject M \ 
9} = Pr{Reject Ml, 6 < a \ 9} + Pr{Reject Mi, 6 > b \ 9}. By Lemma H we have that 
Pr{Reject M, 6 < a \ 9} is non-increasing with respect to ^ G no less than a and that 
Pr{Reject M, 6 > b \ 9} is non-decreasing with respect to ^ G no greater than b. This leads 
to the upper and lower bounds of Pr{Reject M \ 9} in statement (VII). 

Statement (VIII) can be shown by virtue of Lemma [2] based on the observation that 
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{Reject and J^m-i} ^ {^'i < ^ < ^m-il ^■^d that {Reject and is determined 

by the random tuple (Xi, • • • , X^) as a consequence of the definition of the test plan. 

Finally, we shall show statement (IX). Note that Pr{Reject and J^m-i \ ^} < Sl=i Pr{2 < 
-Df < m — 1 I 0}. Define S = {j : gij-i < fij, 2 < j < m — 1}. In the case that S is empty, 
Pr{2 < Di < m — 1 \ 9} = 0. In the case that 5 is not empty, let r G 5 be an integer such fi^y. = 
maxifej : j G S}. Then, Pr{2 <Di<m-l\e}< Pr{d(, < f^^r I 0} < max{/3j : 2 < j < m - 1} 
for 9 G 0m~i- On the other hand, if we let r G 5 be an integer such that gi^r-i = ^^^^{ge,j-i ■ j £ 
S}, then Pr{2 < Di < m - 1 \ 9} < Pr{0£ > ge^r-i \ 0} < max{aj : 1 < j < m - 2} for 6* G ©o- 
This proves statement (IX) and concludes the proof of the theorem. 

C Proof of Theorem [2] 

Theorem [5] can be established by making use of Lemmas [TJ [21 and [3] and an argument similar to 
the proof of Theorem [H 

D Proof of Theorem [4] 

For arbitrary parametric values 9q < 9i in @, by the assumption that converges in probability 
to 9, we have that Pr{v?„ > \ 9o} < Pr{|</J„ - 6*01 > | 6lo} ^ and Pr{(^„ < \ 

9i} < Pr{|(^„ — ^i| > ^^2^" I ^i} — )• as n — )• oo. This shows that n exists and is finite. By the 
definition of the testing plan, we have 

a s 

Pr{Accept J^o \ 0} = ^ Pr{ Accept J^o, I = i \ 9} <Y^ Pr{Dc = 1 \ 9} 

s s 

= ^Prjgf <F(n,,0o,ei,ao,/3i) 1^} <5IPr{^^^^^("^^i'/'i) 1^}- 

1=1 e=i 

Since F^^{z,9) is non-decreasing with respect to z G /g^ for any given G 0, we have Pr{0^ < 
F{ni,9i,l3i) I 9} < Pr{Fg^(S^,6li) < /3i | 6*} for ^ = 1, • • • , s. Since 0^ is a ULE of 6^, by Lemmad 
we have that F-g^{z,9) = Pr{Oi < z \ 9} is non-increasing with respect to 9 no less than z. This 
implies that Pr{Fg^(0^, 9i) < f3i \ 9} < Pr{Fg^(0£, 6*) < /5i | 6*}, ^ = 1, • • • , s for 6* G no less than 
01. Therefore, Pr{Accept Jifo \ 9} < El=i Pr{-D£ = I \ 9} < El=i Pr{Fg^(^£, ^) < Pi \ 9} < s/3i 
for G no less than 9i, where the last inequality follows from Lemma [TJ By a similar method, 
we can show that Pr{Reject J% \ 9} < ^i^i Pi{D£ = 2 \ 9} < sao for G no greater than 9q. 
By the definition of the testing plan and the assumption that the likelihood ratio is monotonically 
increasing with respect to 6i, we have that the test procedure is a generalized SPRT. Hence, the 
monotonicity of Pr{ Accept | 9} with respect to 9 is established. This concludes the proof of 
the theorem. 
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E Proof of Theorem [7] 



We need some preliminary results. 

Lemma 4 Let Xi,--- ,Xn be i.i.d. Gaussian random variables with mean // and variance a"^ . 
Define f^§^ where X„ = and ct„ = ^J^^^fIJx~^n}^ . Then, f is a ULE of ^. 

Proof. Let xi, • • • , a;„ be observations of Xi, ■ ■ ■ , Xn- Then, the logarithm of the corresponding 
likelihood function can be expressed as 



h{xi, ■■■ ,Xn,fJ-,0) = y^ln 



i=l 



Define gixi,--- ,a;„,pt,cr) = X;r=i In (7^) ~ 



1 / ix,-^,f 

Then, 



where 6 = —. 

a 



dh{xi,--- ,Xn,li,9) dg{xi,--- ,Xn,fi,a) dg{xi, ■ ■ ■ ,Xn, n,a) da 

H — = 0, (26) 



9/i dfi 
dh{xi,--- ,Xn,lJ-,9) dg{xi,--- ,Xn, tJ-,cr) da 



da 



86 



da 



do 



(27) 



Since a = ^ and / 0, equations (p6]) and (j27|) can be written as 

dg{xi,--- ,Xn,fi,a) 1 ^ 
9;^^ = >^(x, - ^) = 0, 



55(xi, • • • , x„, ^ _n ^ 1 y _ , ^ ^_ 

a a'^ ^-^ 



da 



(28) 
(29) 



1=1 



Define /i = ^' and cr = y^^^LiO^^i^^^- Then, fj, = fi, a = a is the solution of equations 
()28p . ()29p with respect to fi and a. Hence, setting 9 = ^, we have that 



dh{xi,--- ,Xn,fi, 



dh{xi,--- ,Xn,lJ.,9) 



d9 



and that the likelihood function is monotonically increasing with respect to 9 < 9 and is mono- 
tonically decreasing with respect to 9 > 9. This implies that T is a ULE of ^. The proof of the 
lemma is thus completed. 

□ 



Lemma 5 For any 5 € (0, 1), is monotonically decreasing to as n increases from 2 to 00. 
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Proof. For simplicity of notations, let V'C'^) = Then, 6 = Prj-j^L > tn^s} = ^''^{^ > 
'ip{n)}, where U and Z are independent random variables such that [/ is a Gaussian variable 
with zero mean and unit variance and that Z is a chi-squared variable of n degrees of freedom. 
Since ^ possesses a Student's t-distribution of n degrees of freedom, its mean and variance 

are, respectively, and Accordingly, the mean and variance of are, respectively, 

Chebyshev's inequality, Pr{-|^ > V-} < (n^2)U»)]^ ' leading to 5 < („_2)[^(n)]^ . i-e-, 
'i/;(n) < ^ — )■ as n — 7- oo. This proves lim„_>.oo = 0. 

To show the monotonicity, it suffices to show that, for any fixed t > 0, Pr{|J7|/\/Z > t} 
decreases monotonically with respect to n. Let Vi,--- ^Vn-,Vn+i be i.i.d. Gaussian random 
variables which have zero mean, unity variance and are independent with U. Then, Pr{|J7|/ 



^/Z > t} = Pr{|C/|/yElT^f > 0- In view of V^m/^TJ^W > > ^^{\U\NY.t' V,' > 



and Pr{|C/|/v/ElUW > V'W} = Pr{|f/|/VE:Li > ^(^ + 1)1 = we have Pr{|C/|/^Eri > 
+ 1)} > Pt{\U\/^J J2i=i '^t > ''I'i''^)}^ which implies ip{n + 1) < tp{n). This completes the proof 
of the lemma. 

□ 



Lemma 6 lim^-^o = 1 . 

V 2 In s 

Proof. For simplicity of notations, we abbreviate Zs as z when this can be done without intro- 
ducing confusion. By virtue of the well-known inequality 1 — $(z) < cxp (7)) we have 
S < ^i=exp f— ^) (7), or equivalently, > ^'"^2^^'' + 1' which implies liminf2_j.oo > 1 



and, consequently, limsup^^Q , ^ < 1. On the other hand, making use of the well-known in- 

V 2 1" - 

equality -^exp (—-r) (2 ^ P^) ^ ^ we have S > -^exp (i) (l — which implies 

< ^ In f ^^l^') + 1 and thus liminf5_^o -/S= > 1- This establishes lima^o -1= 



□ 



Lemma 7 Let X be a chi-squared random variable with n degrees of freedom. Then, Pr{X > 
n(l + k)} < [(1 + K)e~'']t for any n > and Ft{X < n(l - k)} < [(1 - K,)e'^]^ for < k < 1. 

Proof. For simplicity of notations, let c = n(l + k). Then, 



< inf E 




= inf / 


p>0 




P>0 Jo 



inf e"''^(l -2p)^t / ^y^~^e~^ dy = inf e^P^n - 2p)~^ , 
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where we have introduced a change of variable — x = | in the integration. Note that 
j-ple-P^il - 2p)-t] = - c)e-'"=(l - 2p)-t, which equals for p = > 0. Therefore, 



Pr{X>n(l + K)} < exp 



c — n 

( 

2c 



1 o c— n 

^ ^ 2c 



1 + K 



for any k > 0. Similarly, Pr{X < n(l — k)} < (^^) ^ for < k < 1. This completes the proof 
of the lemma. □ 



The following result is due to Wallace [S]. 
Lemma 8 Let F{t) he Student's t- distribution of n degrees of freedom. Let x{t) he the root of 



equation = F{t) with respect to x. Then, y {n — ^) In (l + ■^) < x{t) < y nlii (l + ^) for any 
t > 0. 



Lemma 9 For any e > 0, there exists a numher C* > such that 



and all n > k{(, g) = min | 
Proof. Define 



tn,a — tn,f3 



< e for any ( G (0, C* 



hiC,n) 



In 1 



I > 1, where C* is independent of n and g > 0. 



In 1 



n,/3 



for n > k{C, q)- We shall first show that h{(,n) tends to 1 uniformly for n > k{C, g) as C ^ 0. 
Applying Lemma [HI we have 



£i < In ( 1 + ^1 < ^ 



Z2 

zi 

n 



(30) 



and thus 



1 \ fZaV n-^fZaV , n fZa^V ( 1 



for n > By Lemma El we have 



(^y 



lim — — = lim 

C^o Z/3 c^o 



21n^ 



21n4- A/21ni/ J21ni 



= 1. 



It follows that h{C,n) tends to 1 uniformly for n > q) as ^ ^ 0. By virtue of (|30p . we have 

f2 \ -72 -72 



In I 1 + ^] < < 



2 



n-\ k(C„q)-\ g 



and 



ti 



Z2 
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t t 

uniformly for n > k{C,, q) as C, ^ 0. Therefore, both and are bounded uniformly for 
all n > q) and any C, G (0, 1). By virtue of this result and recalling that h{C,n) tends to 1 
uniformly for n > g) as ( ^ 0, we have that ln(l + -^) — ln(l + -^) tends to and thus 
t„,a-t^,i3 ^gjjjjg Q uniformly for n > k{C, q) as — ?• 0. This completes the proof of the lemma. 

□ 



Lemma 10 For any A > 0, J2n=K{(;,g)+iP^{\§^ - e\ > A \ 9} ^ as ( ^ 0, where K{C,g) = 
Proof. We shall first show that Y.n=K{c,e)+i^^ 

<6' — Z\|6'|— >Oas(^— T-Oby considering 

two cases: (i) 9 > A; (h) 9 < A. 

In the case oi 9 > A, let ry be a positive number such that (1 + rj){6 — A) < 9. Then, 

Pr\^<9-A\9\ < Pr < 0- Z\, a„ < (1 + ?7)a I + Pr{5„ > (1 + r/)a I 0} 

[ CTn } [ <^n J 

< Pr{X„ < (1 + r])a{9 - A) \ 9} + Pr{5„ > (1 + r])a \ 9} 
= Pt{U > + 7])A - r]9]} + Pr{xLi > ^(1 + V?} 

< Fv{U>^/^[{l + r])A-r|9]} + Pr{xl^l>{n-l){l+r])}, (31) 

where J7 is a Gaussian random variable with zero mean and unit variance and Xn-i ^ chi-square 
variable of n — 1 degrees of freedom. By the choice of r], we have {l+r])A — r]9 > as a consequence 
of {l + rj){9 - A) <9. Hence, 



Pr {[/ > ^[(1 + ri)A -r]9]} < exp [-^[{l + v)^ - V^] ) ■ (32) 
On the other hand, by Lemma [71 we have 

Pr{xLi > (n - 1)(1 + 7?)} < [(1 + r?)e"''](""i)/2. (33) 
Combining ([311), ([MD and ([Ml) yields 

OO ^ CO 

pJ±l<0.A\9\< [exp(-^[(l + r?)Z\-^0]2) + [(l + ^)e-'']("-^)/2 , 

where the right side tends to as C —S" because k(C, ^) — )• oo as C — ^ 0. 

In the case of < Z\, let r] € (0, 1) be a number such that (1 — r\)(9 — A^) < 9. Then, 

Prji^ < e-Z\ I ^1 < Pr < 0- Z\, a„ > (1 -?7)(j I ^1 +Pr{5„ < (1 -r/)a I 0} 

< Pr{X„ < (1 - r])a{9 - A) \ 9} + Pr{5„ < (1 - r])a \ 9} 

= PT{U>^/^[r]9 + {l-r])A]} + PT{xl^l<n{l-^]f}. (34) 
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By the choice of rj, we have 77^ + (1 — rj)A > as a consequence of (1 — rj)(9 — A) < 6. Hence, 



Pt{U > ^/n[r]e + (1 - 'n)A]] < exp ( --^M + (1 - • 



n , 



(35) 



For smaU enough C > 0, we have n > q) > ^ and thus 

Pr{xLi < n(l - r?)2} < Pr{xLi < (n - 1)(1 - ??)} < [(1 - 7?)e^]("-i)/2, (36) 
where the last inequahty fohows from Lemma [71 Combining (j34p . ()35p and (j36p yields 



n , 



( -^['f» + (1 - + 1(1 - >))e"ll"-"'' 



n=K(C,e)+l 

where the right side tends to as ^ —t- because £») — s- 00 as C ~^ 0. This proves that 
Yl'n=K{C q)+i^'^{^^ < — Z\ I 0} — 7- as C ~^ 0. In a similar manner, we can show that 
Y1'^=k{c q)+i Prj^ > ^ + I 6*} — )• as C — ^ 0. This concludes the proof of the lemma. 



□ 



Lemma 11 Let 5 = 0{C,) G (0, 1). If C > is sufficiently small, then 



1^1 



n 



> exp 



4n 



> 1 



for 2 <n < 



, where < g < ^^_^^g^y2 ■ 



Proof. Prom Wallace's inequality restated in Lemma [HI we have 



' exp 



n 



1< ^ < 



exp 



Z2 
^5 



n 



1, V5g(0,1) 



and thus 



1^1 V^/^ V^y 1^1 



exp 



Z^ 



Therefore, to show the lemma, it suffices to show that 
1 



' exp 



Z2 
n 



1 



exp 



n — i 



> exp 



ln| 

4n 



> 1 



for 2 < n < 



(37) 



if C > is small enough. By Lemma [U for small enough ^ > 0, we have 



In < and thus 



exp 



?2 



exp 



In 



exp 



In 



> exp 



> exp 



3??, 



3fp 



1 > exp 



3(n+l) 



1 4(1 + 101)2 
3^ 3 
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for 2 < n < 



. Hence, 



\ 



exp 



n — I 



1 > 



exp 



'p-2 N 



n 



1 > exp 



4n 



> 1 



for 2 < n < 



^2 



if C is small enough. Therefore, to guarantee (f37|) . it suffices to make C small 



enough and ensure that 



' exp ( ) - 1 > (1 + 



exp 



71. — i 



1. 



By Lemma [U we have lim^_>o 
■^4- > §1 and consequently, 



r- = 2. This implies that, if > is sufficiently small, then 



72 
^5 



1 

4^ 



for 2 < n < 



. Hence, 



(#) - 1 f #) - 1 exp (f 



> 



exp ( ^] - 1 exp ' ^ 



> 



exp ( ^ 



for 2 < n < 



, and consequently (I37p is ensured if C > is small enough. This completes 



the proof of the lemma. 



□ 



Lemma 12 Let 6' < 9" and k{(, q) = min | 



}■ 



Then, 



lim 



< 9" — 



V Pr <! — < ^" + ~ ^»-i./3 I ^ 



n=K(C,e) + l 

/or ^ > 9" provided that < g < Qf^-^_^^g^y2 ■ Similarly, 



lim 



/or 9 < 9' provided that < g < q^i_1^q^-^2 ■ 



= 
(38) 

= 
(39) 



42 



Proof. Without loss of generality, assume that (" is sufficiently small so that q) is greater 
than 2. We shall first show that 

lim y Pr 4^ < e" - ^^^=M= \d\=0 (40) 

for 61 > e". Obviously, lim^^oPr {J^ < 0" - 7^ | 6'} = for n = 2 and 6* > 6". Hence, to 
show (jlOj) . it remains to show 

lim y Pr 4^ < 0" - ^;=i^ 1^=0 (41) 

for 6* > 9". We shall show ([H]) by considering three cases: (i) 9 = 0; (ii) 9 < 0; (iii) 6* > 0. 
In the case of = > 0", we have 

5: prj^ < e»-h^ I A<Y, pj < I A < ,(^,,) ^. 

Noting that 

^'/7q 1 

k(C, ^)/3<^Zj^x/3 = fpx ^^-^ X /3 X 21n — ^ 

as C — 0, we have that (|4ip is true for the case of = > 9" . Hence, it remains to show that 
(j4ip is true for the cases of ^ < and 9 > 0. Let 

An = 9\/n - 1 (^l - + i„,_i,^ - n = 3, 4, • • • . 

Note that 



< E p J < I e]+y M^r. > 1 9} 

n=3 1^ «=3 

K(C,e) 

n— 3 



Clearly, 

t^iCg) ^/P< qZ%x ^= QX X y;3x21n— ^0 

21n^ VP 
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as C ^ 0. Hence, to show gH), it suffices to show lim^^^o J2n=3^ Pr{Z\„ > | 61} = for 6^ < 
and e>0. 

In the case of < 0, we have 



Pr{Z\„ > I 61} = Pr 



< Pr 



\6\ v^fT^ 



By Lemma [TTl for small enough > 0, we have 



Pr{Z\„ > I 61} < Pr < — > exp 



Ini 



4(n - 1) 



Pr 



a 



> 



n — 1 



n 



■ exp 



Ini 



4(n- 1) 



for 3 < n < f?). By Lemma [U we have that In > if C is small enough. This implies 

that 



exp 



6(n - 1) 



> exp 



Z2 



18(re- 1) 



> exp 



and thus 



n — 1 



Inl 



■ exp 



4(n- 1) 



> V 2 exp 



Ini 



4(n - 1) 



18n 



3 exp 



> exp 



In 4^ 



6(n - 1) 



exp 



Ini 



Q{n - 1) 



> 



exp 



(l8£> 



exp 



Ini 



6(n - 1) 



> V 3 exp 



1 



Ini 



Ini 



18 X 1 



exp 



6(n- 1) 



> exp 



6(n- 1) 



for 3 < ?i < q) if C is small enough, where we have used the assumption that q < ^^^^^^y^ < g- 
Therefore, for small enough ^ > 0, we have 



a 



Fr{An > I 6*} < Pr <^ — > exp 



Ini 



6(n - 1) 



for 3 < n < k(<^, q) and it follows that 

Pr{Z\„ > I 61} < Pr |a„ < f7/3^K^^ I 6*1 = Pr jxLi < - 1) 



< 



^3(n-l) exp ( 1 - 



(n-l)/2 



(42) 



for 3 < n < K{(,g). Noting that ^k{C,q) < 2^jln-^ for small enough and invoking the 
assumption that < g < < g, we have 



/36 exp 



k{C, q) 



< /36 exp ^2£.ln--^^ 



(43) 



as C — ^ 0. It fohows from (j32|) and that, in the case of 6* < 0, 



«(C,f) 



^ Pr{Z\„ > I 0} < ^ e{"-i)/2 = x 



exp 



n=3 



71=3 



1 



< 2 /36 exp 



k(C, £») 



■ 
(44) 



44 



as C — ^ 0. 

In the case of ^ > 0, by virtue of Lemma [TT\ we have 



Pr{Z\„ > I 0} = Pr (l - ^ > i 



< Pr <{ 1 - ^ > 1 J> = Pr{CT„ < 0} = 



for 3 < n < k{Ct s) provided that ^ is smaU enoug h. It foUows that En=3^^ Pr{Z\„ > \ 9} = 
for ^ > if C > is sufficiently small. Therefore, we have shown that (j40p holds for 9 > 9". 
Next, we shall show that 

for 9 > 9" . By Lemma [9l there exist a number Z\ > and C* £ (0, 1) such that 

9' + 9" tn-l,a — tn-l,f3 



2 ^ 2V^5rn: 

for any ^ E (0, C*)- It follows from Lemma [TO] that 



<9-A, \/9> 



< 



'"=k{C,£')+1 





< 


9' + 9" 
2 + 


Xn 


< 


9-Z\ 1 









2^/^r^ 



"=k(Ci£')+1 



5n 



> Z\ I ^ ^ (45) 



as C 0. Combining (j40D and (gS]) leads to p8[) . 

Now we want to show that (13911 is true. It suffices to show that 



lim 

C->o 



n=2 



9 \ = 



and 



lim 



y Pj. > + I tn~l,a - tn~l,f3 I g] _ p 

t^.^i W„ - 2 2V^r^ J 

n=K(C,£i)+l 



(46) 



(47) 



for 9 < 9" under the assumption that < < g^jqqgjp-- Clearly, for n = 2 and 9 < 9", 
PtI^> 9' + %= I 6l| as C 0. Hence, to show gHl), it suffices to show that 



lim 



n=3 



(48) 



for 9 < 9' . We can show (148p by considering three cases: (i) ^ < 0; (ii) 9 > 0; (iii) = 0. 



45 



Note that, for <6', 



< V Pr ^-^^ '- > tn-i,c. - ^ — + eV^r^ e \ 



n— 3 



< 



n— 3 ^ ^ 
n— 3 ^ n— 3 



n— 3 



where 



and 



An = 9Vn - 1 ^1 - - t„_i,^ + in-i,a, n = 3, 4, ■ 



1 



«^(C, e) ^<Q Z X ^/a. = — — X X 2 hi — 



as C — )• 0. 

In the case of > 0, by Lemma [TT| we have 
Pr{Z\„<0|n = Pr/l-:^ <-i^*"-^'" 



for 3 < n < f?) if ^ is smah enough. Hence, by a similar method as that for proving (|44p . we 
have hm^^o T.nif Pr{Z\„ < | 0} ^ as C ^ 0. 
In the case of < 0, by Lemma [11] we have 

Pr{Z\„ < in = Pr 1 1 - > ^ f - \ <pJl-^>l\=0 

for 3 < n < q) if is small enoug h. Hence, lim^^o Tl=f Pr{Z\n < | = for < if 
C > is small enough. 

In the case of = < 0', we have 

«(C,e) . 

^3 l'^" ^/^^ J 

as C — ^ 0. Therefore, (|48|) is true for all three cases. As a result, (|46p is true for 9 < 9' . 

By a similar method as that for (|45p . we can show that (j47p is true. Finally, combining (|46p 
and (jl7|) leads to ([39]) . This completes the proof of the lemma. 
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□ 



Now we are in a position to prove the theorem. Statement (I) can be shown by virtue of Lemma 
[2] and the observation that {Reject J^q} C {0 > 0'^} and that {Reject J^q} is determined by the 
random tuple (Xi, • • • , X^) as a consequence of the definition of the test plan. Similarly, statement 
(II) can be shown by virtue of Lemma[2]and the observation that {Reject M'm-i\ C {0 < ^^-il 
and that {Reject M'rn-i} is determined by the random tuple (Xi, • • • ,Xn) as a consequence of 
the definition of the test plan. 

To show statement (III), note that 



m—l 



Pr{Reject J^j\e}<Y^ Pr{ Accept \ 0} + Pr{ Accept JTi \ 9}. (49) 

i=l i=j+l 



By Lemma [5l we have 



f ^ all r, ft' f ^ ^'i _i_ ^"f-l.gj tne-l,l3i 

Je,i < , ge,i > f^i, je,i < — ^ \ 2y/ni - 1 

for i = 1, • • • , m — 1 and i = 1, - ■ ■ ,s. Hence, by the definition of the testing plan, we have 

Pr{ Accept I 0} < y Ft ( ^ < 6'/ - ^^^^ \ o] 



n=2 

oo 



for i = 1, • • • ,m, where k can be any integer greater than 2. Making use of (I50p and applying 
Lemma [12] with k = k(C, q), we have that 

lim Pr{ Accept \ 0} = 0, V6' > 6'/, i = !,■■■ , m. (51) 



Similarly, by the definition of the testing plan, we have 

Pr{Accept^in < ^ Pr > 0^ + | ^| 



n=2 

oo 



for i = 1, ■ ■ ■ ,m — 1, where k can be any integer greater than 2. Making use of ()52p and applying 
Lemma [12] with k = k(^, q), we have that 

lim Pr{ Accept ^ | 6*} = 0, < 6^^, i = 1, • • • , m - 1. (53) 

Therefore, statement (III) follows from (j49]) . (|5T]) and (|53]l . 
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Statements (IV) and (V) can be shown by virtue of Lemma [2] and the observation that 
{Accept C {0^ < < Q'Ij^^ and that {Accept ^} is determined by the random tuple 
(Xi, • • • , Xn) as a consequence of the definition of the testing plan. 

To show statement (VI), by the definition of the testing plan, we have that {Reject J^} is 
determined by the random tuple {X\^--- ,Xn). Moreover, for any numbers o and h such that 
d'l < a <h < we have that {Reject J^} = {Reject < a} U {Reject ^i,e>h} 

and {Reject J^, < a} n {Reject J^, > 6} = 0, which imply that Pr{Reject | 
6*} = Pr{Reject J^, < a | 6*} + Pr{Reject M'i, > h \ Q}. By Lemma d we have 
that Pr{Reject < a | 0} is non-increasing with respect to no less than a and that 

Pr{Reject > 6 | 0} is non-decreasing with respect to Q no greater than 6. This leads to the 
upper and lower bounds of Pr{Reject | 0} in statement (VI). 

Statement (VII) can be shown by virtue of Lemma [2] and the observation that 

{Reject and M'm-\\ ^ {^'i < ^ < and that {Reject and ^^rn-\\ is determined 

by the random tuple (Xi, • • • , Xn) as a consequence of the definition of the testing plan. 

Finally, statement (VIII) can be shown by making use of statement (III) and the observation 
that {Reject and C {Reject and {Reject and ^rn-\\ ^ {Reject 

This concludes the proof of Theorem [71 
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